-- Logs begin at Thu 2022-06-02 08:20:30 UTC, end at Thu 2022-06-02 09:35:14 UTC. -- Jun 02 08:51:13.790544 dv-cinder-825492-19-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 08:51:13.799262 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 08:51:13 2022] *** Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: nodename: dv-cinder-825492-19-iscsi Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: machine: x86_64 Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: clock source: unix Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: pcre jit disabled Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: detected number of CPU cores: 4 Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: current working directory: / Jun 02 08:51:13.801234 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: detected binary path: /usr/bin/uwsgi-core Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: your processes number limit is 47680 Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: your memory page size is 4096 bytes Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: detected max file descriptor number: 2048 Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: lock engine: pthread robust mutexes Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: thunder lock: enabled Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 08:51:13.801913 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 08:51:13.848879 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: Python main interpreter initialized at 0x5561b759b9c0 Jun 02 08:51:13.848879 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: python threads support enabled Jun 02 08:51:13.848879 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: your server socket listen backlog is limited to 100 connections Jun 02 08:51:13.848879 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: your mercy for graceful operations on workers is 90 seconds Jun 02 08:51:13.849245 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 08:51:13.849321 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: *** Operational MODE: preforking *** Jun 02 08:51:13.849575 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: *** uWSGI is running in multiple interpreter mode *** Jun 02 08:51:13.849575 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: spawned uWSGI master process (pid: 80254) Jun 02 08:51:13.849777 dv-cinder-825492-19-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 08:51:13.852437 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: spawned uWSGI worker 1 (pid: 80266, cores: 1) Jun 02 08:51:13.852437 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: spawned uWSGI worker 2 (pid: 80267, cores: 1) Jun 02 08:51:13.852437 dv-cinder-825492-19-iscsi devstack@keystone.service[80254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 08:51:19.562405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 08:51:19.562405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: from cryptography.utils import int_from_bytes Jun 02 08:51:19.563175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 08:51:19.563175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: from cryptography.utils import int_from_bytes Jun 02 08:51:19.563660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 08:51:19.563660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: from cryptography.utils import int_from_bytes Jun 02 08:51:19.564108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 08:51:19.564108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: from cryptography.utils import int_from_bytes Jun 02 08:51:19.613104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 08:51:19.613295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 08:51:19.613490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] command line args: [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 08:51:19.613760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 08:51:19.613897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 08:51:19.613978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ================================================================================ {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 08:51:19.614096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 08:51:19.614182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] admin_token = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.614291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] command line args: [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 08:51:19.614414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] config_dir = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.614562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 08:51:19.614640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.614741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ================================================================================ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 08:51:19.614819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] config_source = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.614940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] debug = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] admin_token = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config_dir = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] config_source = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] debug = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.615946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_config_append = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.616905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_dir = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_file = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_config_append = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_dir = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.617809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.618984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.619955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.620931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] publish_errors = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.621964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] publish_errors = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] standard_threads = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.622922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623244 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] standard_threads = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] use_journal = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] use_json = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.623984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] use_stderr = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] use_syslog = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_journal = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_json = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.624891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.625006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_stderr = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.625120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.625244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] use_syslog = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.625244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 08:51:19.625472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.625472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.625687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.625801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.625915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.626986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.627401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.627520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.627634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.627757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.627872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.627986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.628933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.629957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.630905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.631757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.632365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.632489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.632605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.632719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.632834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.632948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.633991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.634999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.635889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.636959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.637921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.638883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.639992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.640960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.641989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.642943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.643886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.644973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.645931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.646987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.647114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.647285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.647405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.648973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.649919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650856 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.650971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.external = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.651964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.external = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652233 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.password = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] auth.token = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.652941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.password = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] auth.token = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.653885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.654804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.655827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.656889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.657963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.658907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.659992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.660944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.661893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.662968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.663989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664221 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.664931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.665889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.666955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.667939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.668890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.669950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.670906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.671920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.672986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.673929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.674983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.675970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.676903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.677969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.678995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.679963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680192 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.680909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.681966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.682914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.683998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] role.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] role.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.684943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.685900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.686960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.687960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.688913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.689970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.690913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.691907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.692975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.693917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.694033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.694150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.694275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.694995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.695973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.696923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.connection = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.697885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698710 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.698942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.699917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.700971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.701948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 08:51:19.702294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 08:51:19.728272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.728502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.728677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.728769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.728916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.729143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.737283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.737764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.766361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.766581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.766968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.767204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.821123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.821540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.870742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.870985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.871411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.871652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.938473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.938707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.938897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.938986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.939822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.940043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.963999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.964778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.976535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.976847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.989991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.990124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.990206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.990338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.990429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.990585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:19.990806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 08:51:20.007746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.007955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 08:51:20.008155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.008287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.008368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 08:51:20.008491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 08:51:20.008688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.008769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.008893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 08:51:20.009008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.009163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.009264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.009426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.009506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.009687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.009943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.020547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.020822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.021022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.021123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.021301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.021384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.021570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.021851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.030010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.030638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.033313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.033594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.033877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.033957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.034156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.034239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.034435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.034515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.034756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.034845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.035889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.036002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.036153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.036276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.036552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.036825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.062900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.063847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.064637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.064920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.065569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.065855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.070214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.070490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.070769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.071222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.071489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.071772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.078068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.078351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.079055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.079362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.082842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.083261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.083549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.083826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.083907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.084097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.084244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.084369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.084530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.084637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.084798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.085401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.085594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.085870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.086141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.086410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.105436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.105759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.105907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.106039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.110734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.114030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.114409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.114706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.117746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.118041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.119804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.123064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.123452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.126688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.128824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.129127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.129416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.129709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.129989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.130269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.132097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.132399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.132686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.132980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.133259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.133539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.150004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.150287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.150557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.150820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.158781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.158868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.159068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.159369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.159635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.160635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.160914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.164607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.164890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.165170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.165452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.165746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.168187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.169899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.170173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.173226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.173503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.173780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.174058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.174351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.179245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.179535 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.179818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.180101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.180382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.180656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.180946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.187806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.188084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.188364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.188641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.188920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.189190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.189460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.199117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.202419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.205771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.207430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.207514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.209111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.209393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.209674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.211258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.214563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.216186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.217678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.217841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.218117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.218393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.219342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.222569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.222862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.223149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.223458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.226413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.228070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.231281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.231574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.231854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.232135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.233200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.233489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.233882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.241222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.241513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.241899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.242018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.242300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.242581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.242859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.243132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.243454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.243731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.243999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.244274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.244544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.244815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.245095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.245368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.245627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.249826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 08:51:20.250111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.250411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.250693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.250963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.251285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.251560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.251836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.252365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.252630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.252899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.253174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.253443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.253699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 08:51:20.284316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5561b759b9c0 pid: 80267 (default app) Jun 02 08:51:20.287564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94e1ea-4794-473f-84fd-7173b2ef70b5 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:20.287864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94e1ea-4794-473f-84fd-7173b2ef70b5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:20.288738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94e1ea-4794-473f-84fd-7173b2ef70b5 None None] PATH_INFO: `/v3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:20.292354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5561b759b9c0 pid: 80266 (default app) Jun 02 08:51:20.293005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Jun 2 08:51:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:29.002513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:29.003065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:29.003065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:29.007449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:51:29.013505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:29.013922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:29.014056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:29.083174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: INFO dbcounter [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] Registered counter for database keystone Jun 02 08:51:29.104332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG oslo_db.sqlalchemy.engines [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 08:51:29.110530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writer thread running {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 08:51:29.389430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG passlib.handlers.bcrypt [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80267) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 08:51:29.389841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG passlib.handlers.bcrypt [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80267) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 08:51:29.444836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:29.446427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:29.569043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 08:51:29.764104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:29.832556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: INFO dbcounter [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] Registered counter for database keystone Jun 02 08:51:29.852213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG oslo_db.sqlalchemy.engines [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 08:51:29.858955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writer thread running {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 08:51:30.079870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7b5f-bdb1-46d8-a522-b2819f21de59 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:30.084111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:30.084768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:30.085060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:30.085340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:30.093990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:30.145476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 08:51:30.145818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e07b3-8f27-4ac4-b2ea-972bc3a450f0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:30.155707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jun 2 08:51:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 08:51:30.161673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:30.175976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3456982-38bd-4202-93b9-d423078ef00e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:30.180478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:30.181588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:30.181876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:30.182162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] PATH_INFO: `/v3/projects/4962d1508e764b5186cbd90b7013448e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:30.183693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] RBAC: Authorizing `identity:get_project(project_id=4962d1508e764b5186cbd90b7013448e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:30.235391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 08:51:30.235737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd130-d103-43ec-ab70-9c352b823adf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:30.240335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Jun 2 08:51:30 2022] GET /identity/v3/projects/4962d1508e764b5186cbd90b7013448e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:32.431938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af35703-0c66-4c59-ac9b-9ca64cf1ad61 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:32.432451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af35703-0c66-4c59-ac9b-9ca64cf1ad61 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:32.432560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af35703-0c66-4c59-ac9b-9ca64cf1ad61 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:32.436596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:32.442020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:32.442402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:32.442581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:32.461733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:32.463973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:32.471908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 08:51:32.493569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af35703-0c66-4c59-ac9b-9ca64cf1ad61 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:32.506140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af35703-0c66-4c59-ac9b-9ca64cf1ad61 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:32.510937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca80ca-3ebc-4ef2-8c3b-c4d086ac7799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:32.511619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca80ca-3ebc-4ef2-8c3b-c4d086ac7799 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:32.511910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca80ca-3ebc-4ef2-8c3b-c4d086ac7799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:32.512192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca80ca-3ebc-4ef2-8c3b-c4d086ac7799 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:32.519878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca80ca-3ebc-4ef2-8c3b-c4d086ac7799 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:32.521659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca80ca-3ebc-4ef2-8c3b-c4d086ac7799 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:32.530992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jun 2 08:51:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 08:51:32.536240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:32.545323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f144a2-1974-4de8-b480-2b9b373ea829 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:32.549810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4389e2-0e8d-44fd-9419-365054241794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:32.550679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4389e2-0e8d-44fd-9419-365054241794 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:32.550963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4389e2-0e8d-44fd-9419-365054241794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:32.551258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4389e2-0e8d-44fd-9419-365054241794 admin admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:32.552666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4389e2-0e8d-44fd-9419-365054241794 admin admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:32.554519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4389e2-0e8d-44fd-9419-365054241794 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:32.556195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Jun 2 08:51:32 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:34.847245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e25add-8108-4cb4-b52a-11221ddc4abe None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:34.847790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e25add-8108-4cb4-b52a-11221ddc4abe None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:34.847918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e25add-8108-4cb4-b52a-11221ddc4abe None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:34.849288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:34.854974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:34.855417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:34.855564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:34.872592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:34.873752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:34.880100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777422-9ce3-415e-b35b-145f2c393570 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:34.880393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777422-9ce3-415e-b35b-145f2c393570 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:34.880673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777422-9ce3-415e-b35b-145f2c393570 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:34.882025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:51:34.886961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:34.887276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:34.887567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:34.928845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG passlib.handlers.bcrypt [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80266) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 08:51:34.929280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG passlib.handlers.bcrypt [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80266) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 08:51:34.957625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:34.977033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:34.979177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:34.981466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.004985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.078489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:35.083816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62c22-e22a-4668-878c-df40892bc9ee None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.100968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.118439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.119262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.119564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.119849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.131196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:35.142394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:35.143362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:35.144170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:35.149757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.200408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d89be-a2ba-4b2d-a84f-567be4d09cad None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.202660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.230186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.241563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.242587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.242882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.243192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.248059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc4ab1-f317-41ac-b0c5-7dc3f2153125 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.282876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.283575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.283863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.284143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.284899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:35.285210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.286619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.299963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:35.305362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.312140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.313668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.406132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b66cb-73d9-4745-bb86-a1282403b5ed None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.412134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:51:35.417648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.420752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.439933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.440810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.441094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.441374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.442624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.444136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.445809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:35.451644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.467842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.515311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a5a0b-c930-4204-a896-2ec481d6063a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.553375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689347e-f825-42c5-8491-4de1250cb011 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.553710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.554442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.554729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.555014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.578402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.580432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.588735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.589543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.589826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.590109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.591358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.592821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.594693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:35.600113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:51:35.607844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:35.608876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:35.609715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:51:35.609715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:51:35.609715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:51:35.609715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:51:35.609715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:35.616007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:35.686710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.701860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:35.725608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec588-46ab-477c-a572-4ea9d06f1ce5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.736590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f56f-2cc3-4c44-942a-7664fd3f6656 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:35.768212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.768885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.769174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.769457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.770329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.domain.id=default, user.id=7467262b6fdb458fb130b708a0227640) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:35.770644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.772152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18b88d-b161-4568-95a8-698ff7f195b8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.777049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:35.777727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:35.778022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:35.778301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:35.779026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:35.779108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/role_assignments?user.id=7467262b6fdb458fb130b708a0227640&scope.domain.id=default&role.id=1824060ea6e647969fbd916218fe88ea => generated 233 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:35.779374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:35.780779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062f63b-e519-4983-86bf-0ada66201f58 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:35.807148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:38.550879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d6ea-e944-4f84-a0bc-bd1536ed4a5c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:38.551950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d6ea-e944-4f84-a0bc-bd1536ed4a5c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:38.552443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d6ea-e944-4f84-a0bc-bd1536ed4a5c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:38.554450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:38.559566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b6da-853d-4be1-a1b5-7f3f91fdaa88 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:38.559994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b6da-853d-4be1-a1b5-7f3f91fdaa88 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:38.560124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b6da-853d-4be1-a1b5-7f3f91fdaa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:38.583953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f166b6da-853d-4be1-a1b5-7f3f91fdaa88 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:38.585376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f166b6da-853d-4be1-a1b5-7f3f91fdaa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:38.676890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb7c9-6144-4e02-b258-8a4cbce5b44d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:38.677545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb7c9-6144-4e02-b258-8a4cbce5b44d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:38.678023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb7c9-6144-4e02-b258-8a4cbce5b44d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:38.678332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:38.679813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:38.685459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c68a0-48da-4964-ae33-50c9faaf01a8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:38.685756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c68a0-48da-4964-ae33-50c9faaf01a8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:38.686039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c68a0-48da-4964-ae33-50c9faaf01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:38.704609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7c7c68a0-48da-4964-ae33-50c9faaf01a8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:38.705807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7c7c68a0-48da-4964-ae33-50c9faaf01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:38.717687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb7c9-6144-4e02-b258-8a4cbce5b44d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:38.771603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:38.803312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 12/25] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:38.819391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9867ab-8271-4b07-b2d2-8d2e24aad245 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:38.820027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9867ab-8271-4b07-b2d2-8d2e24aad245 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:38.820454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9867ab-8271-4b07-b2d2-8d2e24aad245 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:38.822500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:51:38.834864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:38.835390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:38.835812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:38.858539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:38.859994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:38.931611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb7c9-6144-4e02-b258-8a4cbce5b44d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:38.970455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:38.971658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:39.000043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:39.001087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.001543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.002206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.014923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:39.016848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:39.020455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:51:39.043791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:39.044728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:39.045515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:51:39.045515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:51:39.045515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:51:39.045515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:39.047740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:39.048882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:39.107380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb17e41-3333-477b-aa26-5229da5f1b5b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:39.115770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:39.144637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf4a53-45b7-466d-910d-2eaf9b98bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:39.145711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf4a53-45b7-466d-910d-2eaf9b98bd43 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.146265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf4a53-45b7-466d-910d-2eaf9b98bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.146751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf4a53-45b7-466d-910d-2eaf9b98bd43 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.147815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf4a53-45b7-466d-910d-2eaf9b98bd43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:39.149547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf4a53-45b7-466d-910d-2eaf9b98bd43 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:39.157927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced570a4-9aa6-456a-807e-ec9234b97c1b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:39.193751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fadb1a-62c1-4174-b824-6409bcbe74e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:39.194436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fadb1a-62c1-4174-b824-6409bcbe74e7 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.194726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fadb1a-62c1-4174-b824-6409bcbe74e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.195007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fadb1a-62c1-4174-b824-6409bcbe74e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.195799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fadb1a-62c1-4174-b824-6409bcbe74e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:39.197244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fadb1a-62c1-4174-b824-6409bcbe74e7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:39.345288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 15/29] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 08:51:38 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:51:39.347174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312769ce-2b37-4522-9dd3-f328c6b4ad0a None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.347716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312769ce-2b37-4522-9dd3-f328c6b4ad0a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.348192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312769ce-2b37-4522-9dd3-f328c6b4ad0a None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.349983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:39.350983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312769ce-2b37-4522-9dd3-f328c6b4ad0a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:39.442806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 15/31] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 08:51:39 2022] POST /identity/v3/roles => generated 225 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:51:39.445254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.445765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.446317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.467294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:39.470217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:39.610575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:39.625080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312769ce-2b37-4522-9dd3-f328c6b4ad0a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:39.650943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 16/32] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:39.682671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:39.703515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:39.704515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.705203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.706458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.707678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:39.709095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:39.713006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:39.735066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:39.740649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:39.784416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:39.828865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e6ed7-2b5c-4aa3-aed3-c33938366192 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:39.884251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:39.885749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.886227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.886707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.902061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:39.915674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:39.916530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:39.917322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:39.923468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde10d5-9c1d-43e1-863f-354c860596c3 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:39.923881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:39.963477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c14524-2430-4f02-818d-77a272b87d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:39.964889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14524-2430-4f02-818d-77a272b87d4e None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:39.965556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14524-2430-4f02-818d-77a272b87d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:39.966129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14524-2430-4f02-818d-77a272b87d4e None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:39.967337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c14524-2430-4f02-818d-77a272b87d4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:39.969999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c14524-2430-4f02-818d-77a272b87d4e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:39.982390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:40.042694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623141-3627-4be7-b66c-cd2b6f9e5626 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.065444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:51:39 2022] POST /identity/v3/projects => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:51:40.067080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce11e0a-258a-464d-9557-d8a9b1885e9c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.067622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce11e0a-258a-464d-9557-d8a9b1885e9c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.067908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce11e0a-258a-464d-9557-d8a9b1885e9c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.071933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:40.077336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e4b5-3d33-4da7-a7a9-140c3831f6bc None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.077697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e4b5-3d33-4da7-a7a9-140c3831f6bc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.078065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e4b5-3d33-4da7-a7a9-140c3831f6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.089104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.090342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.090983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.091358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.092159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:40.092526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.094193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.098613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1552e4b5-3d33-4da7-a7a9-140c3831f6bc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:40.100751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1552e4b5-3d33-4da7-a7a9-140c3831f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:40.105040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 18/37] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:40.111001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:40.193294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 20/38] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:40.218761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8cfb-12ab-4008-bb09-aa91df8e7074 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.219039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8cfb-12ab-4008-bb09-aa91df8e7074 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.219324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8cfb-12ab-4008-bb09-aa91df8e7074 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.220681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 21/39] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:51:40.223114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f8cfb-12ab-4008-bb09-aa91df8e7074 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:40.235285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:40.244846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e73f92-81de-4b3e-87c3-e8c9c2862b32 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.255392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:40.283706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6f4aa-8f92-49ff-bfe0-ce87df1774c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.284945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f4aa-8f92-49ff-bfe0-ce87df1774c8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.285406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f4aa-8f92-49ff-bfe0-ce87df1774c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.285696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f4aa-8f92-49ff-bfe0-ce87df1774c8 None admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.286971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6f4aa-8f92-49ff-bfe0-ce87df1774c8 None admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.288498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6f4aa-8f92-49ff-bfe0-ce87df1774c8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.290999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 19/40] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:40 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:40.292162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.292284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.292569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.313091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:40.314291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:40.339318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f8cfb-12ab-4008-bb09-aa91df8e7074 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.374280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.374957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.375284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.375556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.376299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.377966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.384437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:40.385277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:40.446609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 08:51:40 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:51:40.447466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:40.497198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aceeec-e1f8-4d39-82af-b5abda4fcfc7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.506683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:40.532116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:40.536893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.537724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.538010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.538288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.539579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.541788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.543723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:40.549789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:40.571810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954bef-d072-4bd3-8358-51c2cfc8b6ba None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.611581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.612539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.612826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.613225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.614508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.616103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.618464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 23/44] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:40.624195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:40.674227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a029cde-39d8-49bc-a365-171fdc1d3f06 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.714016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff6b4f-91a7-47e3-ba2b-3e6e423ccf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.714903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff6b4f-91a7-47e3-ba2b-3e6e423ccf9c None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.715193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff6b4f-91a7-47e3-ba2b-3e6e423ccf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.715503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff6b4f-91a7-47e3-ba2b-3e6e423ccf9c None admin] PATH_INFO: `/v3/domains/default/users/7467262b6fdb458fb130b708a0227640/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.717556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff6b4f-91a7-47e3-ba2b-3e6e423ccf9c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7467262b6fdb458fb130b708a0227640, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.719024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff6b4f-91a7-47e3-ba2b-3e6e423ccf9c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.745238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eb520-7ae8-427a-bdce-2dc49c8c4dfe None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:40.779216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58752c0-9a9b-4267-b868-58dc2ff73c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:40.779841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58752c0-9a9b-4267-b868-58dc2ff73c4b None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:40.780130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58752c0-9a9b-4267-b868-58dc2ff73c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:40.780410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58752c0-9a9b-4267-b868-58dc2ff73c4b None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:40.781120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58752c0-9a9b-4267-b868-58dc2ff73c4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:40.782576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58752c0-9a9b-4267-b868-58dc2ff73c4b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:40.783095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 22/45] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Jun 2 08:51:40 2022] PUT /identity/v3/domains/default/users/7467262b6fdb458fb130b708a0227640/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:51:40.787036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:40.882585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:51:40 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:51:43.013909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b39964-d42f-4b04-a8a2-bd0e15a508ed None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.014433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b39964-d42f-4b04-a8a2-bd0e15a508ed None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.014433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b39964-d42f-4b04-a8a2-bd0e15a508ed None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.015860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:43.021114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f588c-4949-431b-83e4-c96ab07f93a3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.021528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f588c-4949-431b-83e4-c96ab07f93a3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.021689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f588c-4949-431b-83e4-c96ab07f93a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.041402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6b1f588c-4949-431b-83e4-c96ab07f93a3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:43.042600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6b1f588c-4949-431b-83e4-c96ab07f93a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:43.108224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:43.114419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c69a2-889b-4851-a009-de4d2e3e6dbe None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.114788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c69a2-889b-4851-a009-de4d2e3e6dbe None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.115143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c69a2-889b-4851-a009-de4d2e3e6dbe None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.116615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 24/49] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:43.122426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.122723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.123008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.132080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c69a2-889b-4851-a009-de4d2e3e6dbe None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.139671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:43.140865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:43.167902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:43.207809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 26/50] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:43.232035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.234153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c69a2-889b-4851-a009-de4d2e3e6dbe None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.268267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.269056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.269339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.269616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.279661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:43.280335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:43.287969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:43.290264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:43.291025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:43.295584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.329986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ec2c8-a5ec-4792-938c-b2d499be8a2e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.364694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.365491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.365781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.366065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.367275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:43.368747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:43.370367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:43.375916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.387793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:43.394729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effff203-86ed-4dd0-970d-08a25b21ef5e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.428654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.429331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.429619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.429913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.430693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:43.431009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:43.432455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:43.440459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:43.445849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.474279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0039f-5e84-4480-b80a-18f3bc400bc2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.490620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:43.508036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.508739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.509030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.509311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.510027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:43.511513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:43.544924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ea32e-2b27-415a-a127-6943681a9498 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.577725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.578607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.578900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.579184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.580431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:43.581881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:43.583595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:43 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:43.589475 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.613299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:43.624197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 28/55] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jun 2 08:51:43 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:51:43.692536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca791e74-99d8-4d0f-81ce-e00ec40d3562 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.729670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe72a-15ec-4b70-8823-08458c3ccde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.730403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe72a-15ec-4b70-8823-08458c3ccde8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.730697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe72a-15ec-4b70-8823-08458c3ccde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.730980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe72a-15ec-4b70-8823-08458c3ccde8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.732284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe72a-15ec-4b70-8823-08458c3ccde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:43.733763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe72a-15ec-4b70-8823-08458c3ccde8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:43.735659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 28/56] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:43.741521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:43.846793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1ebe1-f899-4118-8f57-33c61afc1dbb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:43.880052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:43.880725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:43.881018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:43.881303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:43.882137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.domain.id=default, user.id=7467262b6fdb458fb130b708a0227640) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:43.882499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:43.884509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853df627-48ad-4e9d-84ce-331cd0124711 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:43.894301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jun 2 08:51:43 2022] GET /identity/v3/role_assignments?user.id=7467262b6fdb458fb130b708a0227640&scope.domain.id=default&role.id=1824060ea6e647969fbd916218fe88ea => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:45.853529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f706d3-9381-41d5-9955-cf5084807808 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:45.854087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f706d3-9381-41d5-9955-cf5084807808 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:45.854087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f706d3-9381-41d5-9955-cf5084807808 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:45.855514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:45.860850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:45.861203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:45.861411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:45.877833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:45.879010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:45.904741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:45.944569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:45.970002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f706d3-9381-41d5-9955-cf5084807808 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:46.059486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:46.068483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f706d3-9381-41d5-9955-cf5084807808 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:46.101991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d3aa7-8805-4f6f-82d5-9f3c2df7cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:46.102779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3aa7-8805-4f6f-82d5-9f3c2df7cfde None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:46.103067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3aa7-8805-4f6f-82d5-9f3c2df7cfde None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:46.103379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3aa7-8805-4f6f-82d5-9f3c2df7cfde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:46.104612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3aa7-8805-4f6f-82d5-9f3c2df7cfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:46.106016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3aa7-8805-4f6f-82d5-9f3c2df7cfde None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:46.107630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 30/60] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:46.112960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:46.210154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6999e-f141-4eb3-8851-83546d2679e4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:46.242415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f641f8c-73b1-4639-bf11-a952320a6054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:46.243660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641f8c-73b1-4639-bf11-a952320a6054 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:46.243947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641f8c-73b1-4639-bf11-a952320a6054 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:46.244225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f641f8c-73b1-4639-bf11-a952320a6054 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:46.244928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f641f8c-73b1-4639-bf11-a952320a6054 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:46.246383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f641f8c-73b1-4639-bf11-a952320a6054 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:46.325812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:51:46 2022] POST /identity/v3/users => generated 275 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:51:49.839586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee840a-a1ff-4108-aa87-23322a5afb08 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:49.840668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee840a-a1ff-4108-aa87-23322a5afb08 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:49.841166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee840a-a1ff-4108-aa87-23322a5afb08 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:49.843283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 31/62] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:49.849019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576086f-bd72-4314-a37a-19e6f9d1926b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:49.849988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576086f-bd72-4314-a37a-19e6f9d1926b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:49.850472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576086f-bd72-4314-a37a-19e6f9d1926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:49.872114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5576086f-bd72-4314-a37a-19e6f9d1926b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:49.873627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5576086f-bd72-4314-a37a-19e6f9d1926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:49.891207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:49.984044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 32/63] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:50.008821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd0c2-c1b1-47eb-9880-ff2a781000a4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.009431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd0c2-c1b1-47eb-9880-ff2a781000a4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.009963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd0c2-c1b1-47eb-9880-ff2a781000a4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.011591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:50.017156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9daaa9-e7b3-479f-87a4-057a6f9a4b0d None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.017451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9daaa9-e7b3-479f-87a4-057a6f9a4b0d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.017732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9daaa9-e7b3-479f-87a4-057a6f9a4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.027819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd0c2-c1b1-47eb-9880-ff2a781000a4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.053639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4c9daaa9-e7b3-479f-87a4-057a6f9a4b0d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:50.054834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4c9daaa9-e7b3-479f-87a4-057a6f9a4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:50.149395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:50.151559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8b76-4a28-45bc-99b6-9bc9ca38d7d3 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.152243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8b76-4a28-45bc-99b6-9bc9ca38d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.152693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8b76-4a28-45bc-99b6-9bc9ca38d7d3 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.154658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 34/66] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:50.160097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bdd82-5c31-4e9b-8e95-143541ce157b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.160489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bdd82-5c31-4e9b-8e95-143541ce157b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.160984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bdd82-5c31-4e9b-8e95-143541ce157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.173174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd0c2-c1b1-47eb-9880-ff2a781000a4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.179451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b22bdd82-5c31-4e9b-8e95-143541ce157b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:50.180703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b22bdd82-5c31-4e9b-8e95-143541ce157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:50.209316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83254a70-c4f9-4185-a9d8-5ca2e69b0f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.210119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83254a70-c4f9-4185-a9d8-5ca2e69b0f08 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.210408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83254a70-c4f9-4185-a9d8-5ca2e69b0f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.210685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83254a70-c4f9-4185-a9d8-5ca2e69b0f08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.222616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83254a70-c4f9-4185-a9d8-5ca2e69b0f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-83254a70-c4f9-4185-a9d8-5ca2e69b0f08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:50.231010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:50.231878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:50.232628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 33/67] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:50.234651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58b77-cedb-4a4e-8f8d-d728976cbe63 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.234951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58b77-cedb-4a4e-8f8d-d728976cbe63 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.235258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58b77-cedb-4a4e-8f8d-d728976cbe63 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.236880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 34/68] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:50.237591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58b77-cedb-4a4e-8f8d-d728976cbe63 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.255820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:50.257340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bccef-d974-425d-8e01-9cead0956b5f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.257643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bccef-d974-425d-8e01-9cead0956b5f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.257930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bccef-d974-425d-8e01-9cead0956b5f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.259446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 36/70] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:50.260392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.264080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bccef-d974-425d-8e01-9cead0956b5f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.275506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.340607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58b77-cedb-4a4e-8f8d-d728976cbe63 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.368265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bccef-d974-425d-8e01-9cead0956b5f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.373156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c421d3-caf3-4f12-84c2-e55198745cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.373953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c421d3-caf3-4f12-84c2-e55198745cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.374243 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c421d3-caf3-4f12-84c2-e55198745cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.374526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c421d3-caf3-4f12-84c2-e55198745cb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.385319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c421d3-caf3-4f12-84c2-e55198745cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-25c421d3-caf3-4f12-84c2-e55198745cb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:50.392956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:50.393846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:50.394809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:50.395742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.395742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.395865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.405356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.405964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.406251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.406532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.407306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:50.407617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:50.409013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94aef5-d9da-4e8c-9a79-f40e5f279b38 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:50.412159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:50.413347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:50.420591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:50.421591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.421885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.422165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.437954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:50.439147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:50.479674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 36/73] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:50.480530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.500494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.504297 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.509424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 38/74] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:50.510245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.588071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58718-a75b-4057-85f9-417ea0e254f0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.607652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a4cb9-41fb-477e-b2c3-a3fb4477e60e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.620440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.621277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.621566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.621847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.632148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:50.640757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:50.641589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:51:50.642333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:50.642958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.642958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.642958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.643144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:50.643221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.643221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:50.643885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:50.644048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.644893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:50.657188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:50.658242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.712893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.722137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.744934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e054ef-fd1a-48e7-91f5-a62f157b5fc0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.761194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ca7cc-d442-4afc-b2a0-82ff14f9a4aa None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.780282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.781155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.781437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.781713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.794056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.794541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:50.794854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.795146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.795464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.796043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:50.797683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:50.798446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.809311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:50.818383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:50.819220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:51:50.820006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:50.821745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.899814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fcab3-693b-485d-a2be-cf5f54b50410 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.919467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc0bf-b398-4d67-b385-47930f98ce80 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:50.926967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.935360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.936169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.936462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.936893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.938091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:50.939609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:50.941502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 39/79] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:50.942184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:50.946468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:50.958574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:50.959343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:50.959631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:50.959907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:50.960651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:50.960956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:50.962475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:50.970666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 41/80] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:50.971469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.043589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baac84-cfb8-4c75-8558-f8d181c23732 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.069221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abdfd-9232-462d-bd4a-358dcc34acf9 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.077656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.198995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.198995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.198995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.198995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.198995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.198995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 40/81] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:51.199545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.199618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.199618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.199618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.199618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.199880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.199952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.199952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.199952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.200143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca4ea-b3ae-404a-a0eb-c17edbe4bb78 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.216233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.216903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.217193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.217482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.218230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:51.218546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.219977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.228629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:51.229218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.277804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 42/83] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:51:51.278659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.327158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ff9d-8273-4036-8283-d968adb085e2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.351723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.360441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.360582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.362205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.362205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.362205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.362682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.364174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.375607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724744c-2cc6-4fb3-80e0-3d278ada9739 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.409472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.410348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.410637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.410918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.412378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.415143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.415519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 43/84] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:51.416437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.483350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 42/85] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:51:51 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:51:51.483350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.523179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd0ccd-3847-4d2e-a5a0-4033fd7de8ba None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.562504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.563189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.564102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.564407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.591567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.597294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94c7e4-2055-46dc-994f-76c88b9a47b6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.638281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.639191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.639515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.639795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.641080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.642577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.644095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.644593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 43/86] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:51.645217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.649080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.708610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.765894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b372c-2b2b-4ab3-a139-f356e532eb1c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.768776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 44/87] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:51:51.770067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.815015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.815919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.816205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.816486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.817685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:51.819164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:51.821438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:51.822214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:51.834159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:51.897727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893400d-2813-444b-813d-391dfad794e8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.935466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8c1a-bda6-4b9b-8ab6-e7afc0d70106 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:51.942970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.943660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.943947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.944274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.974444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:51.975512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:51.976036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:51.976516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:51.991504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:52.031741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.033548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.067716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.070355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.089682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:52.142361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 45/89] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:51:52.143714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.201406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:51:52.202281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.221701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:52.278270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec114-a5d2-42cd-b4bb-0c5764d62b99 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:52.307948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e4f75-4b34-42af-9cff-c8951922ea74 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:52.327261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:52.328514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:52.328806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:52.329093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:52.330814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.332672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.335225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:52.341517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.356961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:52.357640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:52.358095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:52.358390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:52.359665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=50b4717896c84af8a7c8d8637a93ba49) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:52.360259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.362002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.365246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:52.369497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/role_assignments?user.id=50b4717896c84af8a7c8d8637a93ba49&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:52.371956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.536311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c18b5-12e9-4138-b820-1677d073a0f8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:52.538487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:52.574875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c938e-b5f9-49f4-bdd6-ebf631777ac8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:52.604612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:52.605917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:52.606419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:52.606899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:52.609387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.615898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.619480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:52.620815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.650952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:52.652893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:52.653406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:52.653882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] PATH_INFO: `/v3/projects/75d226d757514a469592e88fc5dfe9e9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:52.655887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] RBAC: Authorizing `identity:get_project(project_id=75d226d757514a469592e88fc5dfe9e9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.657834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.660805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/projects/75d226d757514a469592e88fc5dfe9e9 => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:52.662607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.776493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:52.795120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fcac1-88b3-40f9-bd2b-bc1ee8d37da7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:52.833620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:52.834648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:52.835254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:52.835740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:52.836818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=7467262b6fdb458fb130b708a0227640) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:52.837350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.839005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.846532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/role_assignments?user.id=7467262b6fdb458fb130b708a0227640&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:52.849215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:52.874385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3521-70d4-4ce4-9cd9-727f9f513883 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:52.987702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:52.987702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:52.987702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:52.987702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:52.988554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] RBAC: Adding query filter params (role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=50b4717896c84af8a7c8d8637a93ba49) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:52.988554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:52.988554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31137a79-58a6-4d63-9089-f0ff735bf891 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:52.994871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/role_assignments?user.id=50b4717896c84af8a7c8d8637a93ba49&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:53.042569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c5d96-7010-4e44-8c2d-147719ac5d3a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:53.104439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:53.105069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:53.105356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:53.105639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:53.106505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=75d226d757514a469592e88fc5dfe9e9, user.id=50b4717896c84af8a7c8d8637a93ba49) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:53.106823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:53.108378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058bafe-ad06-486e-82d7-5c9472823e61 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:53.120350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:51:52 2022] GET /identity/v3/role_assignments?user.id=50b4717896c84af8a7c8d8637a93ba49&scope.project.id=75d226d757514a469592e88fc5dfe9e9&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:54.143881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08222-97f5-409a-82eb-3a147ababa76 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.144381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08222-97f5-409a-82eb-3a147ababa76 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.144451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08222-97f5-409a-82eb-3a147ababa76 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:54.145804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:54.151805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.152620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.153091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:54.171624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:54.173152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:54.185699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:54.257544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:54.293269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08222-97f5-409a-82eb-3a147ababa76 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:54.320270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:54.443307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08222-97f5-409a-82eb-3a147ababa76 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:54.493220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:54.494424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.494938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.495548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:54.511042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:54.522605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:54.524199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:51:54.524984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:54.527575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 50/100] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:54.536554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:54.666238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170710f-fd01-4d76-9bd0-4d7ed8c77cf1 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:54.707814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:54.708415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.708706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.708988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:54.709752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:54.710062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:54.712012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ef0f-f0d9-4952-b963-80f59cbc8f02 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:54.720586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 51/101] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:51:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:54.726244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:54.853762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:54.885777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687d074-489d-4886-bedf-169289bf8b18 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:54.905923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116bc7-6afb-4dbd-a8a3-2f72daf11ace None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.906532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116bc7-6afb-4dbd-a8a3-2f72daf11ace None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.907048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116bc7-6afb-4dbd-a8a3-2f72daf11ace None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:54.908652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 52/102] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:51:54.913727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.914330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.914825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:54.950123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:54.951360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:54.954256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:54.978184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:54.979008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:54.979322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:54.979608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] PATH_INFO: `/v3/users/b4b129d9cc0a46269bda63440e3ec570` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.019989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] RBAC: Authorizing `identity:get_user(user_id=b4b129d9cc0a46269bda63440e3ec570)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:55.021498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:55.025633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 51/103] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:54 2022] GET /identity/v3/users/b4b129d9cc0a46269bda63440e3ec570 => generated 289 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:55.052673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:55.099381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 53/104] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:55.126576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:55.247410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c664-54ec-41d2-bbde-37033b2f4eda None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:55.286266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a26a46-646c-4c79-9b37-de6b808e71d4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:55.315895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:55.328289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c237a3-78b9-4d64-8926-af1622411ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:55.329076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c237a3-78b9-4d64-8926-af1622411ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:55.329463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c237a3-78b9-4d64-8926-af1622411ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:55.329745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c237a3-78b9-4d64-8926-af1622411ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.364526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:55.365607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:55.366051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:55.366469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.371998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:55.373682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:55.375525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 54/105] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:55.381284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:55.407284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:55.418212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c237a3-78b9-4d64-8926-af1622411ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:55.420029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c237a3-78b9-4d64-8926-af1622411ca9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:55.531585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 52/106] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:51:55.533211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ff46-1f80-4221-8f49-2de71e0afd5a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:55.533661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ff46-1f80-4221-8f49-2de71e0afd5a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:55.534185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ff46-1f80-4221-8f49-2de71e0afd5a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.535628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 53/107] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:55.544775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:55.545259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:55.545682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.573068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:55.574383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945154e6-1062-40fb-8e2b-cfedf37c75de None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:55.574519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:55.610773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:55.622702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:55.623641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:55.631678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:55.632193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.633722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:55.635391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:55.665339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 54/108] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:55.666598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:55.756739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 55/109] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:51:55 2022] POST /identity/v3/projects => generated 302 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:51:55.760559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:55.779367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b12a75-9782-4bac-acda-346f3b514433 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:55.818202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:55.819344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:55.819769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:55.820248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:55.822234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:55.824031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:55.826032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 55/110] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:55 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:55.832187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:55.880739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:55.902173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:55.966204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0ba9d-bf1e-4dcb-8d91-e0977aef5373 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:55.980514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7510-1825-4844-80ad-9fe49574e65d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:56.007477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.011123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.011669 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.012114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.013249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] RBAC: Adding query filter params (role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=b4b129d9cc0a46269bda63440e3ec570) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:56.013712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:56.015394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc165e-a6b9-459d-aa27-dccc16be618e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:56.022531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 56/111] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:51:55 2022] GET /identity/v3/role_assignments?user.id=b4b129d9cc0a46269bda63440e3ec570&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:56.024960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa8c4-3bd3-4942-93a1-069bb2c18d1d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.025399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa8c4-3bd3-4942-93a1-069bb2c18d1d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.025817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa8c4-3bd3-4942-93a1-069bb2c18d1d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.027519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 57/112] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:56.033843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.034397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.034830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.055575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:56.057046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:56.088700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.089461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.089750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.090031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.124290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:56.132541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:56.133759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:56.134783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:51:56.139657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 56/113] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:56.142434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 58/114] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:56.146962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.168621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.209024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:56.296118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a1a4-156f-4f9f-8e5b-b539009ca4c9 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:56.316547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:56.339311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32a20-482e-4a84-8d54-2a5ac76eee57 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:56.340118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.341357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.341785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.342205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.344063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:56.344389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:56.345841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:56.361970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 57/115] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:51:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:56.367622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.382265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.383907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.384951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.385379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.398129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:56.408981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:56.410079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:51:56.410962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:56.413549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 59/116] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:51:56.419378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.520348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc71fa3-7611-4910-9343-8c4ff4909025 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:56.586982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:56.595720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed077f-9ea4-455d-a4cd-63a7827f0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.596546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed077f-9ea4-455d-a4cd-63a7827f0ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.596837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed077f-9ea4-455d-a4cd-63a7827f0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.597120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed077f-9ea4-455d-a4cd-63a7827f0ab4 None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.598439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed077f-9ea4-455d-a4cd-63a7827f0ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:56.599949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed077f-9ea4-455d-a4cd-63a7827f0ab4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:56.604430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 58/117] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:56 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:56.606834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686d2c-7509-4810-8fab-3c2591dd5b88 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.607128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686d2c-7509-4810-8fab-3c2591dd5b88 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.607434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686d2c-7509-4810-8fab-3c2591dd5b88 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.610746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 59/118] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:56.611595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686d2c-7509-4810-8fab-3c2591dd5b88 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.620078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820725-18b0-40cb-a9b4-23ee902671a1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:56.691915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.692597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.692883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.693157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.694126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:56.694521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:56.696529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948b2a-d931-451a-a80b-952e0e7cb970 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:56.710554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:56.713926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 60/119] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:56.716447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.716741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.717121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.761065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:56.762702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:56.784008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686d2c-7509-4810-8fab-3c2591dd5b88 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:56.857091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:56.857893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:56.858175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:56.858453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:56.860754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:56.862224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:56.863966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:56 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:56.870005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.882196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:56.883690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:56.983614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:57.006063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bec63-f298-49fd-b97b-ef5cb7e6b93c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.006697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e1c8d-8f44-42ae-b47e-04c6af4acfdb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.026884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:57.045225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.046685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.047154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.047734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/50b4717896c84af8a7c8d8637a93ba49/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.048191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c799-ffc3-4383-a471-9b1b3ef83567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.049134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c799-ffc3-4383-a471-9b1b3ef83567 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.049489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c799-ffc3-4383-a471-9b1b3ef83567 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.049835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c799-ffc3-4383-a471-9b1b3ef83567 None admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.050867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] RBAC: Authorizing `identity:create_grant(project_id=3e696a5f8ab54da484a0c4f3a8408fec, user_id=50b4717896c84af8a7c8d8637a93ba49, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:57.051286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637c799-ffc3-4383-a471-9b1b3ef83567 None admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:57.052810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637c799-ffc3-4383-a471-9b1b3ef83567 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:57.052975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:57.054647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 61/122] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:56 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:57.056898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080fd08-608b-45d5-9cf2-655ce4b2a8f4 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.063981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080fd08-608b-45d5-9cf2-655ce4b2a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.063981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080fd08-608b-45d5-9cf2-655ce4b2a8f4 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.063981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 62/123] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:57.063981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080fd08-608b-45d5-9cf2-655ce4b2a8f4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.147845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 62/124] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:51:56 2022] PUT /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/50b4717896c84af8a7c8d8637a93ba49/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:51:57.149614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.205247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080fd08-608b-45d5-9cf2-655ce4b2a8f4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.276152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329a47a-d5fd-4879-bd7d-8488eeb5dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.277419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a47a-d5fd-4879-bd7d-8488eeb5dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.279609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a47a-d5fd-4879-bd7d-8488eeb5dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.280056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a47a-d5fd-4879-bd7d-8488eeb5dcd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.305412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329a47a-d5fd-4879-bd7d-8488eeb5dcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b329a47a-d5fd-4879-bd7d-8488eeb5dcd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:57.317702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:57.318857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:51:57.319864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:51:57.331249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:51:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:57.336579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.338222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.338875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.361633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9b26a-1876-430b-8e48-e66f969f179c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.376109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:57.377587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:57.416345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.418056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.418504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.419196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.420988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:57.423416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:57.426684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:57 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:57.428080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.440039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:57.451626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:57.484202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:51:57.491492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.630056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39700e-ad6d-4e85-a29f-8ccfe0d7f527 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.679641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703ef8c-eaf8-42e5-b67e-f4ab59d7ed64 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.693371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.694064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.694348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.694627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.695452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:57.695765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:57.699058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:57.713527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:51:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:57.714351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.748628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.750585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.750871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.751149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/7467262b6fdb458fb130b708a0227640/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.759865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e696a5f8ab54da484a0c4f3a8408fec, user_id=7467262b6fdb458fb130b708a0227640, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:57.761404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:57.814524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:57.852524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841e512-5940-4e8c-a94f-6670aa32cb2d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:57.892182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 65/129] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:51:57 2022] PUT /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/7467262b6fdb458fb130b708a0227640/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:51:57.893035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.910756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:57.911649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:57.911932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:57.912211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:57.937133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:57.945084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:57.946622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:51:57.948181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:57.956283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:57.997649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:58.171694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df827fc6-c18f-4075-ace1-d5a8bde348f7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:58.182261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627415a-dee1-4f00-bd62-7764f912423b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:58.217310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:58.218577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.219075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.219591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.224191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:58.226135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:58.228223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:57 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:58.236400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:58.253690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:58.280862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:58.281578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.281871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.282156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.282936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:58.283264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:58.284786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:58.298228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:51:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:58.306393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:58.403888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a783f4-47a4-4114-9210-223d10d1eddc None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:58.406999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:58.439415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb894-5968-4c27-b4f6-f0d0f90b4ee2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:58.450580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:58.451550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.451849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.452136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.453887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:58.455385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:58.457084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:58 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:58.463725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:58.534854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:58.535804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.536148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.536431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.537727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:58.539802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:58.541786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:58 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:51:58.548176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:58.636044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68044-c072-4be4-9f40-8df67c7552ae None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:58.704818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:58.706511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:58.707607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.707898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.708181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/50b4717896c84af8a7c8d8637a93ba49/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.713131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e696a5f8ab54da484a0c4f3a8408fec, user_id=50b4717896c84af8a7c8d8637a93ba49, role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:58.715384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:58.777546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e96ea-f5a1-4282-ba11-dc83df9dab1c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:58.802879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 68/135] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:51:58 2022] PUT /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/50b4717896c84af8a7c8d8637a93ba49/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:51:58.830556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e39f8-01d0-4096-b54b-5c8447c8f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:58.831863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e39f8-01d0-4096-b54b-5c8447c8f154 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.832370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e39f8-01d0-4096-b54b-5c8447c8f154 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.832857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e39f8-01d0-4096-b54b-5c8447c8f154 None admin] PATH_INFO: `/v3/projects/75d226d757514a469592e88fc5dfe9e9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.834553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e39f8-01d0-4096-b54b-5c8447c8f154 None admin] RBAC: Authorizing `identity:get_project(project_id=75d226d757514a469592e88fc5dfe9e9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:58.836347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e39f8-01d0-4096-b54b-5c8447c8f154 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:58.838337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 68/136] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:51:58 2022] GET /identity/v3/projects/75d226d757514a469592e88fc5dfe9e9 => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:58.844544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:58.847103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5abe-813b-45e2-b417-742f077ee740 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.847658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5abe-813b-45e2-b417-742f077ee740 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.848548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5abe-813b-45e2-b417-742f077ee740 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.851260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 69/137] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:51:58.861775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729417d7-a962-4a5d-9cbb-8e6ebb1eacaa None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:58.862408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729417d7-a962-4a5d-9cbb-8e6ebb1eacaa None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:58.863394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729417d7-a962-4a5d-9cbb-8e6ebb1eacaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:58.903980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-729417d7-a962-4a5d-9cbb-8e6ebb1eacaa None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:58.905204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-729417d7-a962-4a5d-9cbb-8e6ebb1eacaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:58.915614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:59.051894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 70/138] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:59.053415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884d09-7c14-49c8-8dd5-60c6c27d4b76 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.054040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884d09-7c14-49c8-8dd5-60c6c27d4b76 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.054330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884d09-7c14-49c8-8dd5-60c6c27d4b76 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.058583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 71/139] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:51:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:51:59.064365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.064652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.064936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.089539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969fab-68ff-4790-88a1-89cc5adac6d5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:59.090295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:51:59.091784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:51:59.131669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:59.132707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.133072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.133430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] PATH_INFO: `/v3/projects/75d226d757514a469592e88fc5dfe9e9/users/50b4717896c84af8a7c8d8637a93ba49/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.135692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] RBAC: Authorizing `identity:create_grant(project_id=75d226d757514a469592e88fc5dfe9e9, user_id=50b4717896c84af8a7c8d8637a93ba49, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:59.137816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:59.162574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:59.176846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 72/140] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:51:59.177775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:59.222476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 69/141] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:51:58 2022] PUT /identity/v3/projects/75d226d757514a469592e88fc5dfe9e9/users/50b4717896c84af8a7c8d8637a93ba49/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:51:59.245241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:59.314473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b4c5-29de-4f85-ad6f-7c47e06b2b45 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:59.401104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:59.402298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.402801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.403304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.408081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:59.409942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:59.411936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 73/142] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:51:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:59.418003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:59.459478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:59.477276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7741566-aa23-4e62-aa2d-f5026874203b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:59.531047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:51:59.559483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:59.560595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.561030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.561502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.587996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:51:59.595888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:51:59.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:51:59.597465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 70/143] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:51:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:51:59.608250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:59.608799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab37691-d990-4087-ba0e-7bca90479aa1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:59.655092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:59.655818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.657245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.657528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.658266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:59.659752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:59.749239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa3b5-c855-4c1a-9bef-59db426a0692 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:59.759103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 74/144] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:51:59 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:51:59.795381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:51:59.797964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:51:59.797964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:51:59.797964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:51:59.797964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:51:59.797964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:51:59.799080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:51:59.809613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 71/145] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:51:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:51:59.815823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:51:59.977831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424f99-b21a-4198-be17-e4b957f11d01 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:51:59.990085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:00.024646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:00.025551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.025836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.026119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] PATH_INFO: `/v3/users/b4b129d9cc0a46269bda63440e3ec570` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.027385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] RBAC: Authorizing `identity:get_user(user_id=b4b129d9cc0a46269bda63440e3ec570)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:00.029354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:00.035433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 75/146] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:51:59 2022] GET /identity/v3/users/b4b129d9cc0a46269bda63440e3ec570 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:00.037276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:00.062959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:00.178598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4a19-6e4e-4767-9199-9a03ced80d6c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:00.220853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e1e8b-92a6-4491-9dfb-31a5999fef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:00.222112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e1e8b-92a6-4491-9dfb-31a5999fef1b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.222616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e1e8b-92a6-4491-9dfb-31a5999fef1b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.223092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e1e8b-92a6-4491-9dfb-31a5999fef1b None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.224533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e1e8b-92a6-4491-9dfb-31a5999fef1b None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:00.226205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e1e8b-92a6-4491-9dfb-31a5999fef1b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:00.228163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 72/147] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:00 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:00.234016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:00.347287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9003d7-80c9-4b1f-b2fe-80b55915c63f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.347607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9003d7-80c9-4b1f-b2fe-80b55915c63f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.347966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9003d7-80c9-4b1f-b2fe-80b55915c63f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.349619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 73/148] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:00.357136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.357425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.357708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.380993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006080b-02d8-4f80-92f5-a8b61823fd10 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:00.385011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:00.386217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:00.442409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:00.443252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.443543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.443821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/b4b129d9cc0a46269bda63440e3ec570/roles/4b7c1b1bf58848ef8c8923d2ccf0d94f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.449076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e696a5f8ab54da484a0c4f3a8408fec, user_id=b4b129d9cc0a46269bda63440e3ec570, role_id=4b7c1b1bf58848ef8c8923d2ccf0d94f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:00.450553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:00.499322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 74/149] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:00.529591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:00.530843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 76/150] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:00 2022] PUT /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/users/b4b129d9cc0a46269bda63440e3ec570/roles/4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:00.547202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:00.661861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dde7b-9f96-448d-b97e-e59249f20d3f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:00.709293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:00.710053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.710336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.710612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.725964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:00.734200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:00.735114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:00.735917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 75/151] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:00.741611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:00.797783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:00.877560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9d449-59e9-4d5c-ad60-a144a610e177 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:00.923270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:00.923998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:00.924279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:00.924559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:00.925335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:00.925646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:00.927118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:00.940203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 77/152] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:00.944596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:01.033997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:01.066212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f41236-e9a6-44f3-a1ae-59e53e097616 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:01.116851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708bf4d-54c6-43a1-a92f-6bf70762c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:01.117776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708bf4d-54c6-43a1-a92f-6bf70762c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:01.118058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708bf4d-54c6-43a1-a92f-6bf70762c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:01.118332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708bf4d-54c6-43a1-a92f-6bf70762c8f6 None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:01.119599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708bf4d-54c6-43a1-a92f-6bf70762c8f6 None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:01.121082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708bf4d-54c6-43a1-a92f-6bf70762c8f6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:01.122752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 76/153] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:00 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:01.128699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:01.139748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1343c62-f0c6-407a-8dc3-b3d0ee04dc96 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:01.140042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1343c62-f0c6-407a-8dc3-b3d0ee04dc96 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:01.140328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1343c62-f0c6-407a-8dc3-b3d0ee04dc96 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:01.141959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 77/154] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:01.146873 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:01.147163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:01.147487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:01.176946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:01.178137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:01.296486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 78/155] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:01.339107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:01.340526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:01.344599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23efccc-a394-4857-bb96-35457f12925c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:01.405958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:01.406729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:01.407022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:01.407326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:01.438999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:01.483690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1c153-0aa7-4870-aaa1-1a33ffc2ddb4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:01.536371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:01.537228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:01.537514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:01.537816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:01.554169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:01.562197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:01.563058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:01.563867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 79/156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:01.568909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:01.570922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:01.572628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:01.726108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bd01-1c2f-4d48-8281-07a914fdcf5d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:01.787095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:01.793675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:01.794407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:01.794714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:01.794963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:01.795744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:01.806514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:01.806514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:01.807179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:01.810524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 78/157] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:01.812950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 80/158] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:01.816020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:01.822155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:01.966093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cffca-6419-434b-a5ab-3f21f8b75283 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:02.017106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:02.018013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:02.018296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:02.018571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] PATH_INFO: `/v3/users/7467262b6fdb458fb130b708a0227640` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:02.021122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] RBAC: Authorizing `identity:get_user(user_id=7467262b6fdb458fb130b708a0227640)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:02.022591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:02.025171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 81/159] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:01 2022] GET /identity/v3/users/7467262b6fdb458fb130b708a0227640 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:02.031701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:02.119693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:02.160451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f68a7-2e5d-40a5-9d54-6fe7ff4c5065 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:02.177754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f58d1-d0cc-431d-8ddf-b57246106d17 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:02.213391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:02.214284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:02.214593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:02.214855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:02.219979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:02.221482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:02.223644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 79/160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:01 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:02.229211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:02.229579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:02.230250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:02.230538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:02.230815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:02.321578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:02.323112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:02.372794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:02.416221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:02.420803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31f1d3-112e-4b11-92ea-6efa5e6c2b55 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:02.485062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:02.485807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:02.486104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:02.486388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:02.487262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=50b4717896c84af8a7c8d8637a93ba49) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:02.487585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:02.489044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:02.503102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 80/161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:02 2022] GET /identity/v3/role_assignments?user.id=50b4717896c84af8a7c8d8637a93ba49&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:02.518400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 82/162] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:02.524020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:02.664785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb63d-3dc4-4f2b-9cd9-70670d3cba2d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:02.699627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:02.706997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d0dfa-29fe-4ad8-a15b-133674a7f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:02.707935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0dfa-29fe-4ad8-a15b-133674a7f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:02.708227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0dfa-29fe-4ad8-a15b-133674a7f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:02.708507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0dfa-29fe-4ad8-a15b-133674a7f3a0 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:02.709771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d0dfa-29fe-4ad8-a15b-133674a7f3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:02.711308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d0dfa-29fe-4ad8-a15b-133674a7f3a0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:02.713043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 81/163] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:02 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:02.720373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:02.887335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15422b2-57ee-4c88-9e8a-fb3a5a39a843 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:02.959930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:02.960611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:02.961417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:02.961692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:02.962526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=7467262b6fdb458fb130b708a0227640) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:02.962840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:02.964321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de985ba-6355-464c-abc1-bc22106ec689 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:02.970572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 83/164] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:02 2022] GET /identity/v3/role_assignments?user.id=7467262b6fdb458fb130b708a0227640&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:03.047495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f15d2-3f2d-459c-925d-1ab8f9366452 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.048045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f15d2-3f2d-459c-925d-1ab8f9366452 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.048045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f15d2-3f2d-459c-925d-1ab8f9366452 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.049886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 82/165] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:03.055466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e151d1-67ad-4934-9fd7-2dd99a5c4976 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.055762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e151d1-67ad-4934-9fd7-2dd99a5c4976 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.056045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e151d1-67ad-4934-9fd7-2dd99a5c4976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.080655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-52e151d1-67ad-4934-9fd7-2dd99a5c4976 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:03.081879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-52e151d1-67ad-4934-9fd7-2dd99a5c4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:03.102334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:03.160376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 84/166] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:03.185493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f15d2-3f2d-459c-925d-1ab8f9366452 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:03.300370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f15d2-3f2d-459c-925d-1ab8f9366452 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:03.324861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ae4f-14c1-43a7-85cf-162f20e3d22f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.325427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ae4f-14c1-43a7-85cf-162f20e3d22f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.325893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ae4f-14c1-43a7-85cf-162f20e3d22f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.327593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 85/167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:03.349481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.350092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.350580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.365918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:03.367134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.367619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.368069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.377663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:03.379344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:03.394636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:03.404341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:03.405418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:03.406194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:03.409025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 83/168] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:03.415172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:03.543638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:03.557214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 86/169] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:03.606117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8e14-8eb7-45ad-b0be-717436246382 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:03.608061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:03.694305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:03.696067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.696556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.697026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.697977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:03.698503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:03.700143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:03.714810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 84/170] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:03.721995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:03.773546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:03.810047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ce16-b8f2-4595-a6e7-6d4c6731ae05 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:03.872260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:03.873134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.873417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.873699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.895343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:03.902005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:03.902883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:03.904384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:03.905673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 87/171] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:03.912300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:03.925928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139b17e-e0bf-416a-aeaa-f71ff1e4d2bd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:03.967471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:03.995275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:03.996542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:03.997017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:03.997514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:03.999124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:04.000799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:04.003478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 85/172] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:03 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:04.025203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:04.045703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c7d2-6701-486d-b8a7-77956c0be6b0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:04.136033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:04.136896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.137193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.137480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.138252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:04.138574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:04.140654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:04.154594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 88/173] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:04.160109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:04.168437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:04.254117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c739b9-b1ea-4194-b00e-4deee3b723a8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:04.328203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4a1ca-1e2c-4122-b279-7361d82aaeca None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:04.353265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147a3ac-a6d5-43b6-96ce-694cd3c23964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:04.354317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147a3ac-a6d5-43b6-96ce-694cd3c23964 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.354836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147a3ac-a6d5-43b6-96ce-694cd3c23964 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.355344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147a3ac-a6d5-43b6-96ce-694cd3c23964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.386904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:04.387931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.388221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.388499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] PATH_INFO: `/v3/users/50b4717896c84af8a7c8d8637a93ba49` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.390173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] RBAC: Authorizing `identity:get_user(user_id=50b4717896c84af8a7c8d8637a93ba49)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:04.391918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:04.393943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 89/174] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:04 2022] GET /identity/v3/users/50b4717896c84af8a7c8d8637a93ba49 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:04.400060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:04.493769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:04.524530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147a3ac-a6d5-43b6-96ce-694cd3c23964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:04.529067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147a3ac-a6d5-43b6-96ce-694cd3c23964 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:04.565968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:04.630872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c686e-618d-4a4e-8f61-ac759a988b2a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:04.689357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e299dbd-f928-49a6-b5e2-8ea56a6e7bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:04.689942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e299dbd-f928-49a6-b5e2-8ea56a6e7bef None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.690229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e299dbd-f928-49a6-b5e2-8ea56a6e7bef None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.690509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e299dbd-f928-49a6-b5e2-8ea56a6e7bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.748385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 86/175] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:04.750646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770d55b-ccb3-4325-874e-432223d35f64 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.750941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770d55b-ccb3-4325-874e-432223d35f64 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.751222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770d55b-ccb3-4325-874e-432223d35f64 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.756145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 87/176] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:04.757206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770d55b-ccb3-4325-874e-432223d35f64 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:04.821256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e299dbd-f928-49a6-b5e2-8ea56a6e7bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:04.823745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e299dbd-f928-49a6-b5e2-8ea56a6e7bef None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:04.912199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:04.930345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:04.946029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770d55b-ccb3-4325-874e-432223d35f64 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:04.955805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 90/177] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:04.957490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.957917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.958324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.975665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:04.977483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:04.993427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bec5ec-1e16-4ab3-85c8-3717e02f73f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:04.996134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bec5ec-1e16-4ab3-85c8-3717e02f73f3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:04.996687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bec5ec-1e16-4ab3-85c8-3717e02f73f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:04.997162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bec5ec-1e16-4ab3-85c8-3717e02f73f3 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:04.999123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bec5ec-1e16-4ab3-85c8-3717e02f73f3 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.001423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bec5ec-1e16-4ab3-85c8-3717e02f73f3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.004871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 88/178] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:04 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.007019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300b8b-a710-477a-a92f-497d394d3282 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.007883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300b8b-a710-477a-a92f-497d394d3282 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.008787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300b8b-a710-477a-a92f-497d394d3282 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.010767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 89/179] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:05.015577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b300b8b-a710-477a-a92f-497d394d3282 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.051955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 91/180] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:05.053210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.134456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b300b8b-a710-477a-a92f-497d394d3282 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.156089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e82fc9-9c81-4261-9ad7-a012c18da376 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.157997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.175333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987a4a7-ebcc-4f0e-8e7f-ce05bc28e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.176276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a4a7-ebcc-4f0e-8e7f-ce05bc28e8dd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.176556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a4a7-ebcc-4f0e-8e7f-ce05bc28e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.176834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a4a7-ebcc-4f0e-8e7f-ce05bc28e8dd None admin] PATH_INFO: `/v3/projects/75d226d757514a469592e88fc5dfe9e9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.178013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987a4a7-ebcc-4f0e-8e7f-ce05bc28e8dd None admin] RBAC: Authorizing `identity:get_project(project_id=75d226d757514a469592e88fc5dfe9e9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.179533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987a4a7-ebcc-4f0e-8e7f-ce05bc28e8dd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.183574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 90/181] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/projects/75d226d757514a469592e88fc5dfe9e9 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.183574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304f48-54fe-4313-b9d0-9faf09727aaf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.183574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304f48-54fe-4313-b9d0-9faf09727aaf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.183574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304f48-54fe-4313-b9d0-9faf09727aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.198890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.199516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.199803 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.200081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.200922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] RBAC: Adding query filter params (role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=50b4717896c84af8a7c8d8637a93ba49) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:05.201236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.202306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-96304f48-54fe-4313-b9d0-9faf09727aaf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:05.202685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.203526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-96304f48-54fe-4313-b9d0-9faf09727aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:05.209378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 92/182] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/role_assignments?user.id=50b4717896c84af8a7c8d8637a93ba49&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.210203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.229280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.292082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 91/183] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:05.294333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8898a-5a3c-4b95-9df8-972ebc3d75de None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.294884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8898a-5a3c-4b95-9df8-972ebc3d75de None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.295388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8898a-5a3c-4b95-9df8-972ebc3d75de None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.297484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 92/184] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:05.298461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8898a-5a3c-4b95-9df8-972ebc3d75de None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.348587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac100e-6b76-489f-a3f7-b27b17130843 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.389569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4fa0c-87a1-48b9-9a3a-8c9cfedc26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.390639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4fa0c-87a1-48b9-9a3a-8c9cfedc26ef None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.391183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4fa0c-87a1-48b9-9a3a-8c9cfedc26ef None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.391507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4fa0c-87a1-48b9-9a3a-8c9cfedc26ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.404106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4fa0c-87a1-48b9-9a3a-8c9cfedc26ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-add4fa0c-87a1-48b9-9a3a-8c9cfedc26ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:05.412612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:05.413481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:05.414304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:05.414895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8898a-5a3c-4b95-9df8-972ebc3d75de None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.414965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 93/185] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:05.415403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eebb0-d5ce-4d9d-be45-4d3443e58edd None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.415861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eebb0-d5ce-4d9d-be45-4d3443e58edd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.416139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eebb0-d5ce-4d9d-be45-4d3443e58edd None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.421504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 94/186] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:05.421504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351797-5c90-48b6-affe-618311310a1b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.421504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351797-5c90-48b6-affe-618311310a1b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.421504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351797-5c90-48b6-affe-618311310a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.438361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-77351797-5c90-48b6-affe-618311310a1b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:05.439576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-77351797-5c90-48b6-affe-618311310a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:05.452845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.453860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.454351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.454758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.455631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=75d226d757514a469592e88fc5dfe9e9, user.id=50b4717896c84af8a7c8d8637a93ba49) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:05.456102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.458415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.462827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.466064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/role_assignments?user.id=50b4717896c84af8a7c8d8637a93ba49&scope.project.id=75d226d757514a469592e88fc5dfe9e9&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.467770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.491588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.518417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:05.528357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351797-5c90-48b6-affe-618311310a1b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.587212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aae294-66bc-4705-a482-e749d16f7e82 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.625794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011010e-d51d-4a51-8690-9077eaa02f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.627176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011010e-d51d-4a51-8690-9077eaa02f6e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.627702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011010e-d51d-4a51-8690-9077eaa02f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.628201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011010e-d51d-4a51-8690-9077eaa02f6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.641181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351797-5c90-48b6-affe-618311310a1b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.641429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011010e-d51d-4a51-8690-9077eaa02f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-3011010e-d51d-4a51-8690-9077eaa02f6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:05.650119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:05.651050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:05.651877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 94/189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:05.653182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.653182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.653379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.672384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:05.673615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:05.683565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.684675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.684957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.685237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.685989 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:05.686453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.687922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.701043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 96/190] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.702443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.727372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.761117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 95/191] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:05.762743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.774408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.814733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f24b-068f-4cec-b869-280d6dd61d0e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.848346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.849148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.849433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.849710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.850882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.853004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.854653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.856350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.862636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489620c4-4e2a-4968-bac9-8951fb9c1a21 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.895625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.896292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.896570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.896842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:05.897578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:05.897890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:05.899844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:05.907638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 96/193] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:05.908407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:05.947370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.961589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c94cf9-5122-4ef5-9bda-591323c41d7f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:05.981832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:05.996083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:05.996965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:05.997248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:05.997553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] PATH_INFO: `/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.013430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2e03-6390-49e4-92e6-78db7fd14f23 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.013584 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.014906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.016639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:06.017390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.047135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.047979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.048267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.048545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.058972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:06.067015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:06.068129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:06.068932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 97/195] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:06.070400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.122149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af215eae-6fd9-4c3c-b1b8-b1e94f081865 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.156737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.157411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.157695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.157976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.158690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.160176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.166860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7d0ff-0dd1-4c46-9fcd-7132c7c01915 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.194325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.200580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.201506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.201796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.202076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] PATH_INFO: `/v3/users/b4b129d9cc0a46269bda63440e3ec570` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.203315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=b4b129d9cc0a46269bda63440e3ec570)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.204800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.206413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/users/b4b129d9cc0a46269bda63440e3ec570 => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:06.207179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.229995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.235930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 99/197] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:06 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:06.249022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.317573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ece7-c4fa-438c-b748-d60877f6e3d9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.355853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.356523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.356805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.357092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.372479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e63fb2-6f8b-46e2-bd90-4758006aeae6 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.411880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.412573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.412859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.413138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.413937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:06.414248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.415709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.429809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 100/198] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:06.429809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.437125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.441170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.442637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.503338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.556662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254b7d-5403-4d0f-b587-43cd626e498d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.566842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 99/199] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:06.569790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.601520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.602186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.602473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.602754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.676316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.677970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.696699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.702141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e521ec6-6e8b-43a8-a89c-739f20484f9b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.746656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.747814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.748291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.748627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] PATH_INFO: `/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.749886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.751528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.753527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:06.754346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.783610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.794434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 101/201] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:06.799949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.871899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c76b2-9a15-4a38-8e5a-0215fc9bd992 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.913994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.914863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.915145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.915446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:06.916645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:06.928736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:06.931113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:06.932153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:06.932949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80851fe-bd6a-4dc5-b005-afe443d5c146 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:06.970180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:06.982182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:06.983190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:06.983594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:06.984337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:07.021474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:07.055219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a2206-a07f-4147-9e41-3981d203943b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:07.062154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:07.063861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:07.101347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:07.102368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:07.102756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:07.103137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:07.104464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:07.106471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:07.108965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:07.114274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:07.174649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 102/204] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:07.175983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:07.220191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687460e-0ffe-49b1-a31d-75a59c0f8386 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:07.221833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:07.242734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:07.256738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:07.258363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:07.258363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:07.258739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:07.259700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:07.260083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:07.262149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:07.268533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:07 2022] GET /identity/v3/role_assignments?user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:07.269313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:07.287349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcacfa-47e8-4303-ac54-57982ee55c95 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:07.327427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:07.328447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:07.328913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:07.329433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:07.330531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] RBAC: Adding query filter params (role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec, user.id=b4b129d9cc0a46269bda63440e3ec570) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:07.331061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:07.332775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:07.340619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 103/206] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:07 2022] GET /identity/v3/role_assignments?user.id=b4b129d9cc0a46269bda63440e3ec570&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:07.404278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158717f-c3ab-4da4-a366-9d168dde8dae None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:07.457638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1eba74-8f6f-47c2-b586-89e804d7ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:07.459038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eba74-8f6f-47c2-b586-89e804d7ef50 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:07.459647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eba74-8f6f-47c2-b586-89e804d7ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:07.460134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eba74-8f6f-47c2-b586-89e804d7ef50 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:07.468301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1eba74-8f6f-47c2-b586-89e804d7ef50 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:07.470267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1eba74-8f6f-47c2-b586-89e804d7ef50 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:07.472477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:07 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:07.479565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:07.640799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645079a-25cf-4b4b-b9a1-3df68ae4df49 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:07.669498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:07.678910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:07.680497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:07.686886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:07.686886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:07.686886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] RBAC: Adding query filter params (role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:07.686886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:07.686886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3685d-8bf1-4d49-b833-3ae68737481f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:07.690310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:07 2022] GET /identity/v3/role_assignments?user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:08.706539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c073-a448-4a59-85ee-3d3514543069 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:08.707057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c073-a448-4a59-85ee-3d3514543069 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:08.707131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c073-a448-4a59-85ee-3d3514543069 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:08.708671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:08.714681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a725fca-9ce5-4254-95bf-638c291f2571 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:08.715520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a725fca-9ce5-4254-95bf-638c291f2571 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:08.716003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a725fca-9ce5-4254-95bf-638c291f2571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:08.733701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8a725fca-9ce5-4254-95bf-638c291f2571 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:08.735265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8a725fca-9ce5-4254-95bf-638c291f2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:08.809057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 105/210] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:08.833239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c073-a448-4a59-85ee-3d3514543069 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:08.872376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:08.877725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf21f6-5250-4c9c-bdaa-e5d119c13725 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:08.878020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf21f6-5250-4c9c-bdaa-e5d119c13725 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:08.878304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf21f6-5250-4c9c-bdaa-e5d119c13725 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:08.879731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 106/211] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:08.885302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:08.885594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:08.885874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:08.903761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:08.905195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:08.948880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c073-a448-4a59-85ee-3d3514543069 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:08.987302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:08.987925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 107/212] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:08.988569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:08.989090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:08.989497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:08.990830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:08.992984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:08.999182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:09.000770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:09.013624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:09.055671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:09.117415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca5a9-40b9-4456-9c0c-55b417f55c36 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:09.121282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7683f-abb8-4741-8bb7-22e3258c546c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:09.122820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:09.156685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:09.157369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.157656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.157936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.158668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:09.160168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:09.160273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:09.161081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.161474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.161758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.173490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:09.181343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:09.182248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:09.183044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 107/214] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:09.189058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:09.235395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 108/215] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:08 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:52:09.310037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50513ba9-e2cb-42a6-9e4c-0fad532fc876 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:09.351712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:09.352443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.352745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.353026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.353799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:09.354107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:09.355562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:09.365581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 108/216] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:09.371189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:09.484253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c146-d770-4e8c-acad-47abf8c9e61b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:09.492900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:09.521726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53ec4f-d981-4a76-9a62-9979d8ca0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:09.522616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53ec4f-d981-4a76-9a62-9979d8ca0366 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.522927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53ec4f-d981-4a76-9a62-9979d8ca0366 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.523212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53ec4f-d981-4a76-9a62-9979d8ca0366 None admin] PATH_INFO: `/v3/users/5f52a113bcf74bd58756792f7464d096` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.539192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53ec4f-d981-4a76-9a62-9979d8ca0366 None admin] RBAC: Authorizing `identity:get_user(user_id=5f52a113bcf74bd58756792f7464d096)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:09.540766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53ec4f-d981-4a76-9a62-9979d8ca0366 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:09.542843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 109/217] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:09 2022] GET /identity/v3/users/5f52a113bcf74bd58756792f7464d096 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:09.548303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:09.579099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:09.650087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638ef82-1537-401a-ba91-c53f6b991ee2 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.650377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638ef82-1537-401a-ba91-c53f6b991ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.650852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638ef82-1537-401a-ba91-c53f6b991ee2 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.654328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 110/218] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:09.661017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.661307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.661662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.663112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e0bd-f996-4a07-81eb-c5dc5439fd29 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:09.687865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:09.689301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:09.715555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:09.717049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:09.717567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:09.718075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:09.796139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:09.797898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:09.798022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 111/219] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:09.827619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:09.844787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:09.901701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 109/220] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:09.907367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.014496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf60ff-b5da-4c8d-aa7b-98637869e604 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.050485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.051854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.052342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.052818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.054297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:10.056172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:10.058416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 110/221] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:09 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:10.058609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:10.068152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.070536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:10.084759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4a5e8-094f-42b7-8e24-0935c0e02400 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.141169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.142064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.142352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.142626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.168898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:10.177102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:10.177970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:10.178757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 112/222] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:10.186806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.189253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dcadc-47e0-4a0e-b9c0-6133ed91d37c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.232825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.234274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.234767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.235267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.236688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=5f52a113bcf74bd58756792f7464d096) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:10.237624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:10.239734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1460d-cc34-44b4-abf8-ab3e431b5a2f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:10.248086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/role_assignments?user.id=5f52a113bcf74bd58756792f7464d096&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:10.253097 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd874d-07d0-4b5b-9a9b-dde611b64521 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.253248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd874d-07d0-4b5b-9a9b-dde611b64521 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.253447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd874d-07d0-4b5b-9a9b-dde611b64521 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.254972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 112/224] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:10.264920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.265225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.265485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.301440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:10.305419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:10.353646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72ae4-9545-4804-8152-55e2381ff1b5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.415732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:10.424393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.435307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.435307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.435307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.435307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:10.435307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:10.435307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:10.441668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 113/225] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:10.449470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:10.455515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.500718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.535603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:10.617981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2200f75-f2b1-467e-845a-5d00328893e8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.651836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cb9e3-c7f8-4baa-ad1a-448764da5a89 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.672724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.673999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.674490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.674990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] PATH_INFO: `/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.676686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] RBAC: Authorizing `identity:get_user(user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:10.678570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:10.681545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:10.688091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.714344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.715738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.716229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.716701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.731002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:10.744160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:10.745348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:10.746488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:10.750454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:10.756564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.813932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:10.871568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd017a2-aa6a-4440-bfc0-c40533e10343 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.875610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:10.915256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ac2ef-29af-4150-8626-f784eb4da35a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:10.937857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.938652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.938945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.939220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.940102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:10.940328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:10.941724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:10.961676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:10.968435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:10.969224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:10.970321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:10.970818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:10.971339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:10.972861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:10.974542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:10.976545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:10.984142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:11.076355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6232-fd6b-46d5-a84d-a4a30161abe1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:11.112190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:11.113080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:11.113365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:11.113639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] PATH_INFO: `/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:11.114872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:11.116385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:11.118566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:10 2022] GET /identity/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:11.125557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:11.142281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:11.184730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e29608-41d8-4f10-bf6b-365058fff5a0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:11.227767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:11.252978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:11.253931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:11.254217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:11.254494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c/users/b2e7e0125cf9455fbd0dfb2e59f5c25c/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:11.259983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] RBAC: Authorizing `identity:create_grant(project_id=bebd27c1800f48389399e9b034087b3c, user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:11.261967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:11.291929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd157ef-d27b-4fec-adb3-54e000d51b98 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:11.331223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:10 2022] PUT /identity/v3/projects/bebd27c1800f48389399e9b034087b3c/users/b2e7e0125cf9455fbd0dfb2e59f5c25c/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:11.335362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d88ab-c57e-4c1d-8940-bc8eb567cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:11.336357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d88ab-c57e-4c1d-8940-bc8eb567cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:11.336826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d88ab-c57e-4c1d-8940-bc8eb567cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:11.337110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d88ab-c57e-4c1d-8940-bc8eb567cc50 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:11.338525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d88ab-c57e-4c1d-8940-bc8eb567cc50 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:11.340166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d88ab-c57e-4c1d-8940-bc8eb567cc50 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:11.342251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:11 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:11.348225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:11.462988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bf25c-ad8f-41e3-8fbc-b01923695a18 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:11.502256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee0c9-a006-46e2-9859-ff4438753649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:11.504189 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee0c9-a006-46e2-9859-ff4438753649 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:11.504189 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee0c9-a006-46e2-9859-ff4438753649 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:11.504189 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee0c9-a006-46e2-9859-ff4438753649 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c/users/b2e7e0125cf9455fbd0dfb2e59f5c25c/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:11.506115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee0c9-a006-46e2-9859-ff4438753649 None admin] RBAC: Authorizing `identity:create_grant(project_id=bebd27c1800f48389399e9b034087b3c, user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c, role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:11.507646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee0c9-a006-46e2-9859-ff4438753649 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:11.590219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:11 2022] PUT /identity/v3/projects/bebd27c1800f48389399e9b034087b3c/users/b2e7e0125cf9455fbd0dfb2e59f5c25c/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:11.983537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ad23-881d-4205-863f-90e674c58b52 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:11.984058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ad23-881d-4205-863f-90e674c58b52 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:11.984158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ad23-881d-4205-863f-90e674c58b52 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:11.985533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:11.993041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89419075-b843-42bf-9042-20022d38114e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:11.993592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89419075-b843-42bf-9042-20022d38114e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:11.993592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89419075-b843-42bf-9042-20022d38114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.011641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-89419075-b843-42bf-9042-20022d38114e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:12.012841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-89419075-b843-42bf-9042-20022d38114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:12.060143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:12.104053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 118/236] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:12.127144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ad23-881d-4205-863f-90e674c58b52 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:12.242653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:12.279018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ad23-881d-4205-863f-90e674c58b52 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:12.332047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480f32e-3197-48a2-aa00-22dbb6ed251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:12.333215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480f32e-3197-48a2-aa00-22dbb6ed251b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:12.333696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480f32e-3197-48a2-aa00-22dbb6ed251b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:12.334163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480f32e-3197-48a2-aa00-22dbb6ed251b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.347773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480f32e-3197-48a2-aa00-22dbb6ed251b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6480f32e-3197-48a2-aa00-22dbb6ed251b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:12.356382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:12.357257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:12.358047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:12.360715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 119/237] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:12.366353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89419075-b843-42bf-9042-20022d38114e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:12.498435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785b71-3da2-4749-9344-7b11a72d5efc None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:12.498435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785b71-3da2-4749-9344-7b11a72d5efc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:12.498435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785b71-3da2-4749-9344-7b11a72d5efc None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.498435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 120/238] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:12.505672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:12.506229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:12.506724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.527080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89419075-b843-42bf-9042-20022d38114e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:12.544932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:12.548000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:12.594340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:12.595026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:12.595333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:12.595617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.596379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:12.596691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:12.598091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:12.618949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 119/239] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:12.621630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:12.678748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 121/240] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:12.690439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:12.728341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:12.781127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb214b7-39c2-485f-a77c-8ffe44598b10 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:12.796796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:12.817820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:12.819064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:12.819680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:12.820174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] PATH_INFO: `/v3/users/78c8bb8653554a9eb5266b0fc3ba2ec3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.858964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=78c8bb8653554a9eb5266b0fc3ba2ec3)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:12.860489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:12.862234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 120/241] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:12 2022] GET /identity/v3/users/78c8bb8653554a9eb5266b0fc3ba2ec3 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:12.867827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8d102-a09d-41af-b151-a5bc10a35bf9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:12.870173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:12.907652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:12.908465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:12.908751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:12.909030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:12.910415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:12.911925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:12.914291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 122/242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:12.923930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:12.997188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:13.005960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9fda-1d0b-4c7f-9e13-7fc24e2ea8e9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:13.043980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:13.044762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.045124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.045486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.068217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df7e9b-b769-499a-85c0-a6c3c7a3f196 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:13.110764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:13.122022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0a62b-8777-40b0-a866-4a346bfa5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:13.123189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0a62b-8777-40b0-a866-4a346bfa5c48 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.134539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:13.134700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0a62b-8777-40b0-a866-4a346bfa5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.134700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0a62b-8777-40b0-a866-4a346bfa5c48 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.134700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0a62b-8777-40b0-a866-4a346bfa5c48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:13.134925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:13.135014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0a62b-8777-40b0-a866-4a346bfa5c48 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:13.224001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 123/243] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:12 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:13.227157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c856-608a-4d1f-82ef-5f18933ca3f7 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.227422 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c856-608a-4d1f-82ef-5f18933ca3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.227710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c856-608a-4d1f-82ef-5f18933ca3f7 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.230110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 124/244] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:13.230483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:13.239018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.240285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.240459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.259025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 121/245] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:13.265128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:13.289659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:13.290865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:13.433963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 125/246] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:13.445438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e84838-d782-4c6a-adfb-fdb24ce9f57d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:13.472633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:13.484565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:13.485742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.486221 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.487094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.488946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:13.490596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:13.493421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 122/247] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:13 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:13.499635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:13.584817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:13.612500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638db9-2925-494b-8b2a-7d6e878ad7ad None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:13.639150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:13.645828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571081b-7e99-41cd-85ec-02064836c53d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:13.673338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:13.674534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.675025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.676271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.694601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:13.694601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.694601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.694910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:13.695003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.695003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] RBAC: Adding query filter params (role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=78c8bb8653554a9eb5266b0fc3ba2ec3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:13.695003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:13.695003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:13.699212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:13.700107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:13.700916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:13.703434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 123/248] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:13 2022] GET /identity/v3/role_assignments?user.id=78c8bb8653554a9eb5266b0fc3ba2ec3&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:13.704222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 126/249] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:13.710455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:13.845096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6ad00-5c4d-43e3-ac84-0a426ad69bb4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:13.872941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:13.886601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:13.887335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:13.887626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:13.887909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:13.889862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:13.889862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:13.890391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:13.901693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 124/250] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:13.907317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:14.062307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50757507-4120-43a0-a108-44b553f04d59 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:14.105421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad38c-f828-4a74-89fd-cec8275ab879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:14.106305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad38c-f828-4a74-89fd-cec8275ab879 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.106586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad38c-f828-4a74-89fd-cec8275ab879 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.106856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad38c-f828-4a74-89fd-cec8275ab879 None admin] PATH_INFO: `/v3/users/5f52a113bcf74bd58756792f7464d096` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.111952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad38c-f828-4a74-89fd-cec8275ab879 None admin] RBAC: Authorizing `identity:get_user(user_id=5f52a113bcf74bd58756792f7464d096)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:14.113443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad38c-f828-4a74-89fd-cec8275ab879 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:14.115420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 127/251] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:13 2022] GET /identity/v3/users/5f52a113bcf74bd58756792f7464d096 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:14.120784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:14.167321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83213-623b-409a-89dc-2c55fd711c55 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.167660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83213-623b-409a-89dc-2c55fd711c55 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.167882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83213-623b-409a-89dc-2c55fd711c55 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.169317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 128/252] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:14.174705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.174990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.175295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.208261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:14.209455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:14.287437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc36d1-72f2-4c62-82a2-316f2abbac2b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:14.313927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:14.358581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 129/253] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:14.364722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:14.365843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.366323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.367482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.368950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:14.370613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:14.372571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 125/254] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:14 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:14.378687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:14.393108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:14.460025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:14.517358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67907106-ec0f-4fd0-99df-97f94d617e3b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:14.553597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7b58-9de3-484b-9f32-590751718dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:14.555313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7b58-9de3-484b-9f32-590751718dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.555795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7b58-9de3-484b-9f32-590751718dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.556333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7b58-9de3-484b-9f32-590751718dc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.567541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f7b58-9de3-484b-9f32-590751718dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:14.573142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e21971-d8f0-484a-933a-71c203d0fcca None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0f2f7b58-9de3-484b-9f32-590751718dc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:14.578459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:14.579376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:14.580140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:14.586826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 126/255] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:14.588343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204964-74be-4035-a986-25b06eb20f29 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.588774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204964-74be-4035-a986-25b06eb20f29 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.589432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204964-74be-4035-a986-25b06eb20f29 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.592934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 127/256] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:14.593826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204964-74be-4035-a986-25b06eb20f29 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:14.651513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638fddc-6d67-433f-b6fe-6e439c352023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:14.654512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fddc-6d67-433f-b6fe-6e439c352023 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.654944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fddc-6d67-433f-b6fe-6e439c352023 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.656432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fddc-6d67-433f-b6fe-6e439c352023 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c/users/5f52a113bcf74bd58756792f7464d096/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.660084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638fddc-6d67-433f-b6fe-6e439c352023 None admin] RBAC: Authorizing `identity:create_grant(project_id=bebd27c1800f48389399e9b034087b3c, user_id=5f52a113bcf74bd58756792f7464d096, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:14.668460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638fddc-6d67-433f-b6fe-6e439c352023 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:14.739500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204964-74be-4035-a986-25b06eb20f29 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:14.754644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 130/257] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:14 2022] PUT /identity/v3/projects/bebd27c1800f48389399e9b034087b3c/users/5f52a113bcf74bd58756792f7464d096/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:14.761047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.761414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.762143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.767595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:14.803016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:14.804593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:14.805048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:14.805705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:14.807497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:14.808750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:14.810457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:14.810683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:14.812443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:14.831342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 128/258] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:14.837846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:14.881040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:14.978786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bba013-cdba-439f-a103-255b370bca8e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:15.013273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 131/259] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:15.016123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:15.017285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:15.017710 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:15.018153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] PATH_INFO: `/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:15.019609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] RBAC: Authorizing `identity:get_user(user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:15.021362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:15.023588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 129/260] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:14 2022] GET /identity/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:15.031118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:15.048417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:15.127256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:15.225276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708dfbd-38ec-4ef7-8790-e7bea3c8900f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:15.257867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef76c-c957-43fa-80b0-5e819571c088 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:15.301937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:15.303090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:15.303603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:15.304062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:15.325242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:15.339515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:15.340667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:15.341668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:15.344276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:15.350301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:15.357266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:15.357510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:15.357802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:15.360109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:15.462049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:15.480528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd511b2-04bd-4586-99a2-f872e14e9044 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:15.483593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:15.524895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:15.525715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:15.526396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:15.526681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:15.528391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:15.530315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:15.531108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:15.531450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:15.532837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:15.550718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 131/262] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:15.556595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:15.745630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 132/263] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:15.751063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:15.772704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6297-d565-40f8-a702-473f6aee67cb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:15.822403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:15.823323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:15.823615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:15.823898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] PATH_INFO: `/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:15.825132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e7e0125cf9455fbd0dfb2e59f5c25c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:15.826622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:15.828624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 132/264] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:15 2022] GET /identity/v3/users/b2e7e0125cf9455fbd0dfb2e59f5c25c => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:15.836644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:15.894376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:15.909204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:15.949038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af183f-712e-49b3-8044-a50acb861c80 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:15.990838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:15.992461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:15.992931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:15.993583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.025343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6b4cc-d880-4beb-b2d4-fb0475f96f51 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:16.098188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:16.100195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:16.113519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:16.114449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.114740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.119269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.120163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:16.121787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:16.124005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 133/265] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:15 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:16.129981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:16.179670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:16.254519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de25a4-8d67-4fbb-a8b0-c8b330c0f963 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:16.276948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 133/266] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:16.293742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:16.296072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:16.296729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.297027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.297301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.298897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:16.298897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:16.300196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:16.302336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:16.307517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 134/267] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:16 2022] GET /identity/v3/role_assignments?user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:16.427815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d92094-a4b6-46e9-a674-59a793a90b38 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:16.478037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb177ad-c6d6-4ce7-8790-2b5d4340312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:16.479349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb177ad-c6d6-4ce7-8790-2b5d4340312c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.479841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb177ad-c6d6-4ce7-8790-2b5d4340312c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.480349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb177ad-c6d6-4ce7-8790-2b5d4340312c None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.481901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb177ad-c6d6-4ce7-8790-2b5d4340312c None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:16.483643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb177ad-c6d6-4ce7-8790-2b5d4340312c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:16.485643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 134/268] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:16 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:16.491902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:16.647129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14326d6-33cf-40aa-ab90-8d63374e560f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:16.682960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81e400-9180-4821-b502-16b56672231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:16.683650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e400-9180-4821-b502-16b56672231b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.683934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e400-9180-4821-b502-16b56672231b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.684212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e400-9180-4821-b502-16b56672231b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.685039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e400-9180-4821-b502-16b56672231b None admin] RBAC: Adding query filter params (role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:16.685352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e400-9180-4821-b502-16b56672231b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:16.686937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e400-9180-4821-b502-16b56672231b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:16.693385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 135/269] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:16 2022] GET /identity/v3/role_assignments?user.id=b2e7e0125cf9455fbd0dfb2e59f5c25c&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:16.786538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928eda-e65f-43c5-96dc-66e715384797 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.787137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928eda-e65f-43c5-96dc-66e715384797 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.787454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d928eda-e65f-43c5-96dc-66e715384797 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.789514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 135/270] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:16.795103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.795419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.795698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.824488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:16.825720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:16.904489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:16.912335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3cbf8-a953-41d2-a33e-b31b6feb2d52 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.912801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3cbf8-a953-41d2-a33e-b31b6feb2d52 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.913164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3cbf8-a953-41d2-a33e-b31b6feb2d52 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.915274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 136/271] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:16.915945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 136/272] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:16.933818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29b90-35e5-432c-a65c-1ece03ef3449 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:16.934292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29b90-35e5-432c-a65c-1ece03ef3449 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:16.934716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29b90-35e5-432c-a65c-1ece03ef3449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:16.942843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:16.957348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1df29b90-35e5-432c-a65c-1ece03ef3449 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:16.958575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1df29b90-35e5-432c-a65c-1ece03ef3449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:16.975141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.076777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:17.079507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b0a6f-3058-48e2-a43d-149c31eeaf73 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.083214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b0a6f-3058-48e2-a43d-149c31eeaf73 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.083214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b0a6f-3058-48e2-a43d-149c31eeaf73 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.083214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 138/274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:17.086870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.087163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.087483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.113547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:17.113852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272c0a3-97d1-41ee-93bb-87b27e3ca83e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.114743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:17.158921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.159694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.159977 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.160246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.170461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:17.178132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:17.179570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:17.180356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:17.181008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.199704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 139/276] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:17.201073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.246001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:17.266737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:17.301184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2804a1-bc2b-466d-a2f1-48f25be9bfb2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.304497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823d5ad-b759-4224-a49d-0a340a6667ba None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.337308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.337505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.337989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.338274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.338561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.338906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.339347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:17.339491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.339658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:17.340053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.341069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:17.341574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:17.343356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:17.345131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:17.350334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.356253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 140/278] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:17.356253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.461518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3da25-1a14-4a78-8366-81edebe55a7d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.462061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73cd04-b4c9-40cd-a78b-330845ea3ee9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.480975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:17.487886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:17.495384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.496190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.496475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.496754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.498832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.499542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.499831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.500115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.500832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:17.502539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:17.509245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:17.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:17.518105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 139/279] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:17.524071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.582328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 141/280] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:17 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:17.588537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.636685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110a346-1cc6-4dc0-b469-39cf737dce6b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.695118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.696168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.696538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.696881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] PATH_INFO: `/v3/users/78c8bb8653554a9eb5266b0fc3ba2ec3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.698356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] RBAC: Authorizing `identity:get_user(user_id=78c8bb8653554a9eb5266b0fc3ba2ec3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:17.700015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:17.703464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 140/281] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/users/78c8bb8653554a9eb5266b0fc3ba2ec3 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:17.710010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.733821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d7e42-faed-469e-a7ba-5b20487c0191 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.769576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:17.775746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.779205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.779205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.779205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.779205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:17.779205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:17.780733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:17.790946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 142/282] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:17.796993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.840562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40085f6d-b6e6-45f2-8bce-83012e47db14 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.862193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:17.895358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.896204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.896983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.897284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:17.898622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:17.900271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:17.902079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 141/283] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:17.908003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:17.944233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c9f2-c80e-4a1e-9923-fa4810242cb4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:17.992552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:17.993739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:17.994028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:17.994306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] PATH_INFO: `/v3/users/277fde01cef345688478eb5db6e05335` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.024228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] RBAC: Authorizing `identity:get_user(user_id=277fde01cef345688478eb5db6e05335)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:18.026386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:18.029225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:17 2022] GET /identity/v3/users/277fde01cef345688478eb5db6e05335 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:18.035327 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:18.055456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cedb59-b021-4214-ac4d-aadad5d619f6 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:18.076073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:18.096184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4062d-5f5a-4fac-b50c-8aff3efb1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:18.097096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4062d-5f5a-4fac-b50c-8aff3efb1127 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.097379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4062d-5f5a-4fac-b50c-8aff3efb1127 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.097758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4062d-5f5a-4fac-b50c-8aff3efb1127 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c/users/78c8bb8653554a9eb5266b0fc3ba2ec3/roles/4b7c1b1bf58848ef8c8923d2ccf0d94f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.099938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4062d-5f5a-4fac-b50c-8aff3efb1127 None admin] RBAC: Authorizing `identity:create_grant(project_id=bebd27c1800f48389399e9b034087b3c, user_id=78c8bb8653554a9eb5266b0fc3ba2ec3, role_id=4b7c1b1bf58848ef8c8923d2ccf0d94f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:18.101622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4062d-5f5a-4fac-b50c-8aff3efb1127 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:18.160355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:18.163480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea433e-ebd6-4e75-b949-386f2506d36d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:18.171077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 142/285] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:17 2022] PUT /identity/v3/projects/bebd27c1800f48389399e9b034087b3c/users/78c8bb8653554a9eb5266b0fc3ba2ec3/roles/4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:52:18.173160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d4278-6e13-4258-a728-3dbd747f919f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.173593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d4278-6e13-4258-a728-3dbd747f919f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.174137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d4278-6e13-4258-a728-3dbd747f919f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.175772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 143/286] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:18.182144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.182701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.183118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.207038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:18.209182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:18.229801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:18.230482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.230778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.231041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.232026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, user.id=277fde01cef345688478eb5db6e05335, scope.system=all) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:18.232346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:18.233812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:18.248807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 08:52:18 2022] GET /identity/v3/role_assignments?user.id=277fde01cef345688478eb5db6e05335&scope.system=all&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:18.298479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:18.332196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:18.455032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78d286-9b1d-432c-aa68-b2380aae4b4c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:18.497438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:18.498632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.505882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.505882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.513555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:18.521848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:18.523621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:18.524555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:18.526791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:18.532787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:18.645323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef596-3509-41a4-a60f-9331edd505ba None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:18.653612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:18.688155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:18.689124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.689697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.690116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.691002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:18.691476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:18.693530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:18.704586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:18.711142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:18.751322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:18.848576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972aa0-104f-4d0f-a44f-f82b90eac661 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:18.893325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:18.894408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:18.894793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:18.895170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] PATH_INFO: `/v3/users/5f52a113bcf74bd58756792f7464d096` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:18.896515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] RBAC: Authorizing `identity:get_user(user_id=5f52a113bcf74bd58756792f7464d096)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:18.898102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:18.900165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 146/291] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:18 2022] GET /identity/v3/users/5f52a113bcf74bd58756792f7464d096 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:18.905244 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:19.062960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7576-afbb-4dae-a90f-4f12146348d8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:19.111115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:19.111926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:19.112311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:19.112700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:19.159636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:19.201447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:19.203088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:19.348448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:19.353847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:19.479949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:19.496220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721ad3d-9016-4154-bbb6-47ef4306c78d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:19.550722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765c05-ffb8-40f4-a2ea-e35b10f9392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:19.551630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765c05-ffb8-40f4-a2ea-e35b10f9392f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:19.551917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765c05-ffb8-40f4-a2ea-e35b10f9392f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:19.552198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765c05-ffb8-40f4-a2ea-e35b10f9392f None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:19.553399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf765c05-ffb8-40f4-a2ea-e35b10f9392f None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:19.554916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf765c05-ffb8-40f4-a2ea-e35b10f9392f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:19.556977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 147/293] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:19 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:19.562437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:19.651859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:19.693757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12458381-3361-41e0-aa1a-01f5743bd765 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:19.741325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:19.742409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:19.742696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:19.742971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:19.743849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=5f52a113bcf74bd58756792f7464d096) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:19.744164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:19.745619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e900-e0a4-4a31-adc3-cc8eae5987ed None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:19.752156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 147/294] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:19 2022] GET /identity/v3/role_assignments?user.id=5f52a113bcf74bd58756792f7464d096&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:20.339756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c50d2-eda1-4dd2-aa75-20e68dc94299 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.340128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c50d2-eda1-4dd2-aa75-20e68dc94299 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.340321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c50d2-eda1-4dd2-aa75-20e68dc94299 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.341985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 148/295] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:20.347124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.347461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.347745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.364850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:20.366026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:20.455148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:20.480661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c50d2-eda1-4dd2-aa75-20e68dc94299 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:20.595215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c50d2-eda1-4dd2-aa75-20e68dc94299 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:20.633547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:20.634349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.634633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.634908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.645522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:20.654648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:20.655518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:20.656300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 149/297] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:20.664510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:20.730233 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:20.774127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569aa3d-b4b7-4f31-a20b-9059777b48ba None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:20.812239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:20.812920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.813205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.813481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.814224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:20.814529 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:20.816018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc12c5-c7db-4c32-8877-7584e9d1c371 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:20.825372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 149/298] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:20.830681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:20.853994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:20.859010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c82e-fb57-4f87-8b0b-2d5a261c5b55 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.859328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c82e-fb57-4f87-8b0b-2d5a261c5b55 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.859605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c82e-fb57-4f87-8b0b-2d5a261c5b55 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.861413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 150/299] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:20.868032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa6b0-765d-4eb6-8aff-0917eb2741e7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.868623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa6b0-765d-4eb6-8aff-0917eb2741e7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.868905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa6b0-765d-4eb6-8aff-0917eb2741e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.891929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-3d7aa6b0-765d-4eb6-8aff-0917eb2741e7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:20.893234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3d7aa6b0-765d-4eb6-8aff-0917eb2741e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:20.967613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10271ae2-83e6-4a1c-9042-8419f72800a5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:20.979373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 151/300] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:20.991747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066ad6-7952-48a6-8ba2-2307b466958f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.992045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066ad6-7952-48a6-8ba2-2307b466958f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.992367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066ad6-7952-48a6-8ba2-2307b466958f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:20.993950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 152/301] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:20.998849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:20.999141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:20.999458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.005787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.008154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.008439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.008713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] PATH_INFO: `/v3/users/4438bd7ee8814601be42f8973d09bb8e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.018778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:21.020171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:21.023129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] RBAC: Authorizing `identity:get_user(user_id=4438bd7ee8814601be42f8973d09bb8e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.024687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.026445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 150/302] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:20 2022] GET /identity/v3/users/4438bd7ee8814601be42f8973d09bb8e => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:21.027293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.081458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.098587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 153/303] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:21.100256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.111831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.134347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162135b-cdb1-4f3d-881b-ebe789576f11 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.168667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48ac75-787a-4f51-9334-25893b62224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.169462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48ac75-787a-4f51-9334-25893b62224b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.169752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48ac75-787a-4f51-9334-25893b62224b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.170029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48ac75-787a-4f51-9334-25893b62224b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.171206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48ac75-787a-4f51-9334-25893b62224b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.172687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48ac75-787a-4f51-9334-25893b62224b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.174451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 151/304] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:21.175675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1b5ee-a326-4fdc-b297-f1a0de5db999 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.175969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1b5ee-a326-4fdc-b297-f1a0de5db999 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.176250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1b5ee-a326-4fdc-b297-f1a0de5db999 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.177487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 152/305] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:21.178190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1b5ee-a326-4fdc-b297-f1a0de5db999 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.202695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4abd51-6c7e-4361-81ee-1a6d74123c34 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.236538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.237264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.237578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.237835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.238660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] RBAC: Adding query filter params (role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f, user.id=4438bd7ee8814601be42f8973d09bb8e, scope.system=all) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:21.238969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.240436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.246072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 154/306] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/role_assignments?user.id=4438bd7ee8814601be42f8973d09bb8e&scope.system=all&role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:21.246072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.284028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1b5ee-a326-4fdc-b297-f1a0de5db999 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.312922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.323498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffd82e-4f10-41b9-89a4-86e670eee720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.324319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffd82e-4f10-41b9-89a4-86e670eee720 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.324604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffd82e-4f10-41b9-89a4-86e670eee720 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.324882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffd82e-4f10-41b9-89a4-86e670eee720 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.337121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffd82e-4f10-41b9-89a4-86e670eee720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e2ffd82e-4f10-41b9-89a4-86e670eee720 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:21.345217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:21.346194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:21.347054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 153/307] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:21.348665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.348867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.349152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.363221 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.369894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:21.371124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:21.377330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73702ab-e155-4373-be3a-bcd484f60a96 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.416867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775f27-0074-467c-a53b-88170821139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.417562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775f27-0074-467c-a53b-88170821139a None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.417849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775f27-0074-467c-a53b-88170821139a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.418128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775f27-0074-467c-a53b-88170821139a None admin] PATH_INFO: `/v3/groups` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.418838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57775f27-0074-467c-a53b-88170821139a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.420368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57775f27-0074-467c-a53b-88170821139a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.445429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 154/308] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:21.446290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.497259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 155/309] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jun 2 08:52:21 2022] POST /identity/v3/groups => generated 229 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:21.504361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775f27-0074-467c-a53b-88170821139a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.574263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b775c-1dd6-4086-b09e-be6e03887116 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.624727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.625426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.625709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.625988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.627599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:21.627919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.629684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.633313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.641962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:21.648579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.658192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775f27-0074-467c-a53b-88170821139a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.673374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.711935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.713414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.714180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.714590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.730698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:21.738103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:21.739199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:21.740061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 156/311] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:21.745145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.790200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694fd47-72a6-4738-835e-b419c3c3aade None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.835503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.836775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.837066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.837344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] PATH_INFO: `/v3/users/277fde01cef345688478eb5db6e05335` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.838817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] RBAC: Authorizing `identity:get_user(user_id=277fde01cef345688478eb5db6e05335)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.841041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.847262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 156/312] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/users/277fde01cef345688478eb5db6e05335 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:21.851404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.865001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed784314-6f86-474f-9da5-b31c14a6e034 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:21.902182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:21.903192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:21.903776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:21.904253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:21.905195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:21.905717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:21.907250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:21.916054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 157/313] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:21.927279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:21.941408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.969988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:21.983565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981abb4-749f-4ecf-81e5-2cd086a7633b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:22.023430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:22.024577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:22.025041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:22.025454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] PATH_INFO: `/v3/system/users/277fde01cef345688478eb5db6e05335/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:22.027319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=277fde01cef345688478eb5db6e05335, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:22.028921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:22.046237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6931a-48eb-4779-b446-49792a544d88 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:22.082972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:22.084088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:22.084377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:22.084656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] PATH_INFO: `/v3/users/78c8bb8653554a9eb5266b0fc3ba2ec3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:22.086455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] RBAC: Authorizing `identity:get_user(user_id=78c8bb8653554a9eb5266b0fc3ba2ec3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:22.087976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:22.089926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 158/314] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:21 2022] GET /identity/v3/users/78c8bb8653554a9eb5266b0fc3ba2ec3 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:22.095113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:22.097673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 157/315] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jun 2 08:52:21 2022] PUT /identity/v3/system/users/277fde01cef345688478eb5db6e05335/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:22.210923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c934-e95e-4560-a173-419ee0fbe39a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:22.220914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:22.247791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:22.248574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:22.248864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:22.249148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:22.324085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:22.325547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:22.430812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:22.435872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 159/316] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:22.441435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:22.550817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8e8c-37b1-4bbe-90a0-94320e781f2d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:22.580158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:22.587455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383005-405a-4d0c-b824-6fd54f09d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:22.588337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383005-405a-4d0c-b824-6fd54f09d778 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:22.588626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383005-405a-4d0c-b824-6fd54f09d778 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:22.588958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383005-405a-4d0c-b824-6fd54f09d778 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:22.590184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383005-405a-4d0c-b824-6fd54f09d778 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:22.591690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383005-405a-4d0c-b824-6fd54f09d778 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:22.598264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 158/317] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:22 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:22.599662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:22.713112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b1a4-94f3-4fa6-9168-c95aef822224 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:22.750735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:22.751446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:22.751728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:22.752255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:22.753165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] RBAC: Adding query filter params (role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f, scope.project.id=bebd27c1800f48389399e9b034087b3c, user.id=78c8bb8653554a9eb5266b0fc3ba2ec3) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:22.753395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:22.754827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce06a-80ec-4b38-8039-2762501f5234 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:22.765922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 160/318] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:22 2022] GET /identity/v3/role_assignments?user.id=78c8bb8653554a9eb5266b0fc3ba2ec3&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:23.601926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8e69-c1ca-48a6-bac4-35ee20dea6be None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:23.602439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8e69-c1ca-48a6-bac4-35ee20dea6be None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:23.602543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8e69-c1ca-48a6-bac4-35ee20dea6be None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:23.604225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 159/319] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:23.608930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497881-bc45-4d4f-b4b7-6451cb96b8b6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:23.609226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497881-bc45-4d4f-b4b7-6451cb96b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:23.609500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497881-bc45-4d4f-b4b7-6451cb96b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:23.627065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-04497881-bc45-4d4f-b4b7-6451cb96b8b6 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:23.628272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-04497881-bc45-4d4f-b4b7-6451cb96b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:23.686894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:23.698199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:23.719971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8e69-c1ca-48a6-bac4-35ee20dea6be None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:23.821794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8e69-c1ca-48a6-bac4-35ee20dea6be None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:23.855634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:23.856350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:23.856634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:23.856909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:23.867599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:23.875544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:23.876495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:23.877524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:23.878628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e40e5-723b-47f5-94fc-5b22f7bfc95b None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:23.878628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e40e5-723b-47f5-94fc-5b22f7bfc95b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:23.878628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e40e5-723b-47f5-94fc-5b22f7bfc95b None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:23.881588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 160/321] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:23.882771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 162/322] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:23.882950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:23.884782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:23.885072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:23.885350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:23.901703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:23.902967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:23.946003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:23.979008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 163/323] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:23.990119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6c48-e4f4-4b9c-9e4c-4d6205cf1910 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.001729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:24.032854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.033522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.033831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.034081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.034831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:24.035139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:24.036635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:24.050462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 161/324] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:24.051462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:24.115101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b47c-7276-46fe-adc3-6452abf5cf0f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.142569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:24.155222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.156172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.156455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.156732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.166023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:24.166023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:24.166238 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781a38-e262-4854-8462-a3a409722f07 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.166353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 164/325] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:24.167098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:24.181918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:24.196665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.197541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.197822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.198093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] PATH_INFO: `/v3/users/4438bd7ee8814601be42f8973d09bb8e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.199389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] RBAC: Authorizing `identity:get_user(user_id=4438bd7ee8814601be42f8973d09bb8e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:24.200836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:24.202631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 162/326] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:24 2022] GET /identity/v3/users/4438bd7ee8814601be42f8973d09bb8e => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:24.207854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:24.271067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd155-663f-48ca-8178-dc64597c4d00 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.307674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892c77d-b31b-434d-a21b-756154f3551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.308344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892c77d-b31b-434d-a21b-756154f3551e None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.308629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892c77d-b31b-434d-a21b-756154f3551e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.308905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892c77d-b31b-434d-a21b-756154f3551e None admin] PATH_INFO: `/v3/groups` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.309265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a4fdf-6dfd-4f01-b2a9-756258752bcc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.309596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892c77d-b31b-434d-a21b-756154f3551e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:24.311027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892c77d-b31b-434d-a21b-756154f3551e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:24.342520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e6da7-1d6a-4ac7-bfcb-c41a6aec436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.343443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e6da7-1d6a-4ac7-bfcb-c41a6aec436d None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.343730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e6da7-1d6a-4ac7-bfcb-c41a6aec436d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.344007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e6da7-1d6a-4ac7-bfcb-c41a6aec436d None admin] PATH_INFO: `/v3/system/users/4438bd7ee8814601be42f8973d09bb8e/roles/4b7c1b1bf58848ef8c8923d2ccf0d94f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.345845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e6da7-1d6a-4ac7-bfcb-c41a6aec436d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4438bd7ee8814601be42f8973d09bb8e, role_id=4b7c1b1bf58848ef8c8923d2ccf0d94f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:24.347330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e6da7-1d6a-4ac7-bfcb-c41a6aec436d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:24.393518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 165/327] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jun 2 08:52:24 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:52:24.411728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 163/328] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jun 2 08:52:24 2022] PUT /identity/v3/system/users/4438bd7ee8814601be42f8973d09bb8e/roles/4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:52:24.439775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4134db-987a-4fed-a94b-89c64c4a9bba None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.440100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4134db-987a-4fed-a94b-89c64c4a9bba None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.440352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4134db-987a-4fed-a94b-89c64c4a9bba None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.442159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 166/329] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:24.448031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.448339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.448608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.467784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:24.469070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:24.527029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:24.550798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 164/330] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:24.574841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4134db-987a-4fed-a94b-89c64c4a9bba None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:24.632831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:24.688288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4134db-987a-4fed-a94b-89c64c4a9bba None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.723623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.724437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.724724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.725002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.737513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:24.745520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:24.746394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:24.747163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 167/331] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:24.754055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:24.866764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279db8b3-4303-4e50-b534-cd4ac15e325b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:24.905111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:24.906081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:24.906557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:24.907005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:24.907970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:24.908463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:24.910007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:24.919807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 165/332] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:24.925608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:25.043200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab6499-7d9f-4c9a-9795-b8b68329f0e8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:25.056649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:25.085775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e400ef-9ff1-400f-86b8-bf279dfa482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:25.086653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e400ef-9ff1-400f-86b8-bf279dfa482d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:25.086935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e400ef-9ff1-400f-86b8-bf279dfa482d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:25.087208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e400ef-9ff1-400f-86b8-bf279dfa482d None admin] PATH_INFO: `/v3/users/277fde01cef345688478eb5db6e05335` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:25.088733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e400ef-9ff1-400f-86b8-bf279dfa482d None admin] RBAC: Authorizing `identity:get_user(user_id=277fde01cef345688478eb5db6e05335)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:25.090202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e400ef-9ff1-400f-86b8-bf279dfa482d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:25.091894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 168/333] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:24 2022] GET /identity/v3/users/277fde01cef345688478eb5db6e05335 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:25.097610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:25.162054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:25.228573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264e78-4c81-449c-906d-d87e39de916b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:25.269369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:25.270037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:25.270319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:25.270597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:25.271457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] RBAC: Adding query filter params (role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, user.id=277fde01cef345688478eb5db6e05335, scope.system=all) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:25.271768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:25.273275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07a7b2-2a6e-4dad-b687-2c6ac9ed571f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:25.288053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 166/334] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 08:52:25 2022] GET /identity/v3/role_assignments?user.id=277fde01cef345688478eb5db6e05335&scope.system=all&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:27.052240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756ba70-e46f-400f-ba7f-a7ed5ea39d76 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.052744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756ba70-e46f-400f-ba7f-a7ed5ea39d76 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.052849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756ba70-e46f-400f-ba7f-a7ed5ea39d76 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.054180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 169/335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:27.066985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3426e-4f7b-4e57-afd5-803a95bd1a10 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.067504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3426e-4f7b-4e57-afd5-803a95bd1a10 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.067576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3426e-4f7b-4e57-afd5-803a95bd1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.092245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b0b3426e-4f7b-4e57-afd5-803a95bd1a10 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:27.093451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b0b3426e-4f7b-4e57-afd5-803a95bd1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:27.182131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 167/336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:27.230354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756ba70-e46f-400f-ba7f-a7ed5ea39d76 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:27.295883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82d79-4373-4234-80d1-a9d43114d2a2 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.296167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82d79-4373-4234-80d1-a9d43114d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.296436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82d79-4373-4234-80d1-a9d43114d2a2 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.297803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 168/337] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:27.303295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.303653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.303934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.328074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:27.329304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:27.409878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:27.423084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756ba70-e46f-400f-ba7f-a7ed5ea39d76 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:27.493794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:27.496191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:27.496998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.497281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.497560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.516115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:27.524059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:27.524937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 08:52:27.525725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:27.526312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:27.537465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 170/339] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:27.550147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:27.637915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:27.673309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c35d81-69ee-4c97-97ec-94e3ffaec99b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:27.722217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07326da-916a-485f-94ed-748b6dc92d89 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:27.750135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:27.750135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.750135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.750135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.767279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:27.779746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:27.780707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:27.781889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:27.786965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:27.792969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:27.793908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.794386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.794871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.795855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:27.796364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:27.798132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:27.817387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 171/341] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:27.826397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:27.828436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:27.912758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88baf7-6c62-413c-a351-c21677cb33cb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:27.950821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:27.951541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.951828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.952109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.952877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:27.953188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:27.954621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593a536-eae1-4a43-9560-d816967b8bba None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:27.964448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:27.965717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d462ddf-7f42-4aa4-992d-090da83cfb51 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.966006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d462ddf-7f42-4aa4-992d-090da83cfb51 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.966287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d462ddf-7f42-4aa4-992d-090da83cfb51 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.967556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 172/343] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:27.968901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2754-8115-49c5-ba2c-4d5721c279ce None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:27.969192 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2754-8115-49c5-ba2c-4d5721c279ce None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:27.969460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2754-8115-49c5-ba2c-4d5721c279ce None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:27.970948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 173/344] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:27.971721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2754-8115-49c5-ba2c-4d5721c279ce None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.015660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.019312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60579bec-536b-4efc-bec9-f474f67474be None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.058704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5481a-44e5-4c87-98aa-34eb3c4077b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.060326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5481a-44e5-4c87-98aa-34eb3c4077b8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.060610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5481a-44e5-4c87-98aa-34eb3c4077b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.060889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5481a-44e5-4c87-98aa-34eb3c4077b8 None admin] PATH_INFO: `/v3/users/4438bd7ee8814601be42f8973d09bb8e` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.063985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5481a-44e5-4c87-98aa-34eb3c4077b8 None admin] RBAC: Authorizing `identity:get_user(user_id=4438bd7ee8814601be42f8973d09bb8e)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:28.065842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5481a-44e5-4c87-98aa-34eb3c4077b8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:28.068164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 172/345] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:52:27 2022] GET /identity/v3/users/4438bd7ee8814601be42f8973d09bb8e => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:28.074690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7af784-2607-43af-b5f3-304c06c87996 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.075353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7af784-2607-43af-b5f3-304c06c87996 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.075853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7af784-2607-43af-b5f3-304c06c87996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.076575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.094973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2754-8115-49c5-ba2c-4d5721c279ce None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.097523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-0c7af784-2607-43af-b5f3-304c06c87996 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:28.099051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0c7af784-2607-43af-b5f3-304c06c87996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:28.130601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.131317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.132077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.132363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.177110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 173/346] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:28.179401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.179890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.180359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.198858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:28.200397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:28.225106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:28.226610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:28.278064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 174/347] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:28.279292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.311668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.349297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.378312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 174/348] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:28.379611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.414774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5fdf9-be9c-404a-ba64-86cb14b9345c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.462452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.463630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.464080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.464494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.465690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] RBAC: Adding query filter params (role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f, user.id=4438bd7ee8814601be42f8973d09bb8e, scope.system=all) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:28.466154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:28.468382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:28.491438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 175/349] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 2 08:52:28 2022] GET /identity/v3/role_assignments?user.id=4438bd7ee8814601be42f8973d09bb8e&scope.system=all&role.id=4b7c1b1bf58848ef8c8923d2ccf0d94f => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:28.492528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.535496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d810-b8be-4466-a882-6bdd0eb7dd93 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.587070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.588281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.588789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.589261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.605206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:28.614915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:28.616081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:28.616916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:28.621678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 175/350] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:28.624589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.688530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.712610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.752162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f91f2b-55a7-42cf-b616-93e5864b2272 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.764700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3303-ff8f-4026-bedb-efbdea52d05d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.807567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.809020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.809511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.809998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.812254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:28.813973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:28.816167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 176/351] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:28 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:28.817606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.830792 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.831694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:28.831980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:28.832256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:28.852812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:28.860957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:28.861853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:28.862640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 176/352] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:28.863308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:28.961841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac51c-6d36-47f4-9ec6-988039ec32b9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:28.976081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:28.999055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:28.999806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.000078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.000358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.003149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:29.003149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.003362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.011710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe138cb-c284-4de0-85e6-a3224622499c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.019314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 177/353] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:29.019314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.057465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:29.058816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.059823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.060307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.070239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.072073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.074107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 177/354] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:28 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:29.075312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.090075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.143312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69733350-5584-4325-ab16-6652e7e608e7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.190641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:29.191367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.191654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.191932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.192683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:29.192991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.194458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.199615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773f61c-51a2-48c6-8418-87bc99caeed5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.205166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 178/355] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:29.205823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.248214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a623cb-797f-4b98-aeb2-d301c53057e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:29.248877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a623cb-797f-4b98-aeb2-d301c53057e1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.249187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a623cb-797f-4b98-aeb2-d301c53057e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.249464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a623cb-797f-4b98-aeb2-d301c53057e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.258884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.345847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4765536-512e-47c7-9b04-ba131977e860 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.348750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a623cb-797f-4b98-aeb2-d301c53057e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.350271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a623cb-797f-4b98-aeb2-d301c53057e1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.365831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.396737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:29.398153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.398433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.398703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.400157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:29.400483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.401943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b9d8-768e-43b5-8569-56dd5d160f65 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.407958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 179/356] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:29.411342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f908b-4d57-4543-9e9a-419509d1f467 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.411648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f908b-4d57-4543-9e9a-419509d1f467 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.411926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f908b-4d57-4543-9e9a-419509d1f467 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.413640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 180/357] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:29.420067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f908b-4d57-4543-9e9a-419509d1f467 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.498718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 178/358] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:29.502234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.502234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.502234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.527720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:29.529074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:29.561575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.568081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f908b-4d57-4543-9e9a-419509d1f467 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.616800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 179/359] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:29.617996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.620152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e4cf0-f619-4fd0-b959-efe90f34d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:29.620862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4cf0-f619-4fd0-b959-efe90f34d061 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.621121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4cf0-f619-4fd0-b959-efe90f34d061 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.621390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4cf0-f619-4fd0-b959-efe90f34d061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.683616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.724320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e4cf0-f619-4fd0-b959-efe90f34d061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.725831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e4cf0-f619-4fd0-b959-efe90f34d061 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.747907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c788fc3-f06a-45d6-a90d-85615923f9ce None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.791556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:29.792421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.792702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.792975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.794278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:29.795946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:29.798087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 180/360] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:29.798737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.842605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.851602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 181/361] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:29.853733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5af4-aaa7-4252-b624-c4013c680297 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:29.854087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5af4-aaa7-4252-b624-c4013c680297 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:29.854371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5af4-aaa7-4252-b624-c4013c680297 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:29.855993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 182/362] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:29.856583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5af4-aaa7-4252-b624-c4013c680297 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:29.955104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ecc8-c61e-4cca-ac7d-6dadb13441fe None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.970933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:29.987638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5af4-aaa7-4252-b624-c4013c680297 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:29.999931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.000751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.001040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.001319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.016258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:30.025191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:30.026093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:30.027061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 181/363] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:30.027790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.030955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42df46-8857-4d8d-adab-35807fac0649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.033211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42df46-8857-4d8d-adab-35807fac0649 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.033682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42df46-8857-4d8d-adab-35807fac0649 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.034172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42df46-8857-4d8d-adab-35807fac0649 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.035567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42df46-8857-4d8d-adab-35807fac0649 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.038479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42df46-8857-4d8d-adab-35807fac0649 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.045028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 183/364] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:29 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.045028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.045028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.045310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.065588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:30.066788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:30.142930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:30.146325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e238-015d-4201-978f-12c2f36510b6 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.152059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 184/365] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:30.153387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.189381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.190489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.190941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.191223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.192489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.194472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.196208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 182/366] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.197164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.243300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:30.277324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad173e-8f0d-4ffd-aa4e-5055b8f9ed88 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.327676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.328488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.328903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.329179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.330086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:30.330394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.332190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.333385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726aa6-1bda-475f-ab08-5f23b524e1bf None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.341422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 185/367] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.342254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.382183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.384017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.384017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.384017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.384353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=bebd27c1800f48389399e9b034087b3c) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:30.384673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.386100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.392348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 183/368] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.392666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.433547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:30.484926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cea4e-07c0-41d6-8f45-d414ac1d0c7a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.526474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.527329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.527682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.527964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.544853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:30.546267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:30.549253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55916-57be-49ab-8eb7-378ebe88cefc None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:30.555023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:30.557682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:30.558802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 186/369] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:30.564395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.593464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.594348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.594630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.594906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.596212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.597747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.599713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 184/370] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.601266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.708832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeb7f8-b38d-499c-a893-1bcc3fbedb9f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.730619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e07441-753f-405d-b88c-24b52e618f11 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.739960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:30.757296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.758409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.758694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.759118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.770896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.771617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.771931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.772218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.772970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:30.773310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.774667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.785449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.786325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.829147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:30.859348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.860810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.916447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a37b-9723-477c-8bf6-e26aab45a157 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:30.957947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:30.958613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:30.958893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:30.959168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:30.960092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:30.960400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:30.962009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:30.974594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 186/372] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:30.976223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:30.993821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 187/373] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:31.000386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:31.030896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:31.176285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787eb0f-78d9-4c6e-bd63-ed37a7dbdb5b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:31.192103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:31.203431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feecb0-ab07-4be9-ab29-88009300b379 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:31.244778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:31.245571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:31.245854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:31.246126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:31.248807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:31.250288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:31.254132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 188/374] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:31.259040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:31.273451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:31.273451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:31.273895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:31.273895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:31.399104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:31.401516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:31.407895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:31.422985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ecab-cd0c-4f95-89c4-3bb259c483ce None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:31.463229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:31.464619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:31.465495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:31.465943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:31.467350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:31.469486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:31.471624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 189/375] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:31 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:31.480663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:31.597115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06244c5-9974-4123-803b-e30d0b4e1675 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:31.604916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:31.619045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 187/376] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:31.619996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:31.635762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:31.637068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:31.637774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:31.638443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:31.640124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=bebd27c1800f48389399e9b034087b3c) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:31.640879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:31.643035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:31.650412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 190/377] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:31 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:31.760055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2b10-c9ad-4a8d-b693-e46400576861 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:31.805292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:31.806185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:31.806462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:31.806731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] PATH_INFO: `/v3/projects/4962d1508e764b5186cbd90b7013448e` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:31.808101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] RBAC: Authorizing `identity:get_project(project_id=4962d1508e764b5186cbd90b7013448e)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:31.809551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:31.811627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 188/378] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:31 2022] GET /identity/v3/projects/4962d1508e764b5186cbd90b7013448e => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:31.816628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:31.840937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:31.948585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6bc74-f22e-435e-93d0-2507e704aaeb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:31.998041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491c00-84dc-4e95-8f88-f2747cff3cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:31.998929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491c00-84dc-4e95-8f88-f2747cff3cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:31.999211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491c00-84dc-4e95-8f88-f2747cff3cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:31.999510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491c00-84dc-4e95-8f88-f2747cff3cb8 None admin] PATH_INFO: `/v3/groups/7832b07b206542eda14336928e209360` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.009610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491c00-84dc-4e95-8f88-f2747cff3cb8 None admin] RBAC: Authorizing `identity:get_group(group_id=7832b07b206542eda14336928e209360)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:32.011069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491c00-84dc-4e95-8f88-f2747cff3cb8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:32.013479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 191/379] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:31 2022] GET /identity/v3/groups/7832b07b206542eda14336928e209360 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:32.019260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:32.090234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:32.112563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b827-5e73-4e68-a474-82b4ff02555b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:32.112878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b827-5e73-4e68-a474-82b4ff02555b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:32.113123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b827-5e73-4e68-a474-82b4ff02555b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.115187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 192/380] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:32.120870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:32.121164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:32.121452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.140383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c190e77-5284-4980-af3b-8b97d9e1e868 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:32.156322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:32.157529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:32.181206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:32.182194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:32.182706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:32.183194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.184263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] RBAC: Adding query filter params (group.id=7832b07b206542eda14336928e209360, role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=4962d1508e764b5186cbd90b7013448e) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:32.184864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:32.186493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:32.193139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 189/381] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:32 2022] GET /identity/v3/role_assignments?group.id=7832b07b206542eda14336928e209360&scope.project.id=4962d1508e764b5186cbd90b7013448e&role.id=1824060ea6e647969fbd916218fe88ea => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:32.281717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 193/382] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:32.322023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:32.452854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36278d33-874d-4064-93af-fe5898277d28 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:32.482794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:32.495213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:32.503173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:32.503173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:32.503173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.510122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:32.518523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:32.519428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:32.520230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:32.524404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 190/383] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:32.528358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:32.549814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:32.649778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344549f0-aa6d-4ffa-8fb3-14ff35e8d224 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:32.689263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:32.689943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:32.690224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:32.690494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.691256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:32.691576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:32.692964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:32.704745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 194/384] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:32.716385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:32.867901 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3252-ced8-4796-8338-3dd9c441af65 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:32.934401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:32.935301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:32.935591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:32.935868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:32.940013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:32.941720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:32.944666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 191/385] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:32 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:32.952330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:33.069349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:33.094011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b2af-178b-4dc9-a9c1-e25337ac1f99 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:33.135177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21d453-91f7-4ca5-93f2-e6dcbb1d8018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:33.136079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d453-91f7-4ca5-93f2-e6dcbb1d8018 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:33.136368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d453-91f7-4ca5-93f2-e6dcbb1d8018 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:33.136738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d453-91f7-4ca5-93f2-e6dcbb1d8018 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:33.137959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21d453-91f7-4ca5-93f2-e6dcbb1d8018 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:33.139450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21d453-91f7-4ca5-93f2-e6dcbb1d8018 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:33.141161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 195/386] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:32 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:33.147547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:33.239888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:33.282799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ea09-36b7-47e0-a1f7-12e12c584431 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:33.322118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01134f3-e2e5-4d74-98b6-5152a2ef5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:33.322929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01134f3-e2e5-4d74-98b6-5152a2ef5064 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:33.323213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01134f3-e2e5-4d74-98b6-5152a2ef5064 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:33.323522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01134f3-e2e5-4d74-98b6-5152a2ef5064 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/groups/7592a29e16f04311b06ac4dbf38245a2/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:33.325911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01134f3-e2e5-4d74-98b6-5152a2ef5064 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e696a5f8ab54da484a0c4f3a8408fec, group_id=7592a29e16f04311b06ac4dbf38245a2, role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:33.327400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01134f3-e2e5-4d74-98b6-5152a2ef5064 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:33.394148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 192/387] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 08:52:33 2022] PUT /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/groups/7592a29e16f04311b06ac4dbf38245a2/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:33.434180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a3e9e-39c8-42df-8f83-39c53954643b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:33.434699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a3e9e-39c8-42df-8f83-39c53954643b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:33.434822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a3e9e-39c8-42df-8f83-39c53954643b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:33.436386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 196/388] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:33.442867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:33.443162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:33.443468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:33.469472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:33.470721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:33.564814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 193/389] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:33.614599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a3e9e-39c8-42df-8f83-39c53954643b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:33.748133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a3e9e-39c8-42df-8f83-39c53954643b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:33.797071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:33.797878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:33.798219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:33.798498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:33.815679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:33.823750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:33.824648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:33.825413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 197/390] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:33.830827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:33.898229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:33.974796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231839-4b69-4c31-b7f2-392be5d93b4b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.031936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.032636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.032925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.033205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.033968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:34.034278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:34.035724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06720381-5695-4b69-aeb2-392252a69e37 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:34.051208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 194/391] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:34.057683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.065301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:34.093084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a112d2-3c0d-4c77-85b0-47fc72b75ead None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.093376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a112d2-3c0d-4c77-85b0-47fc72b75ead None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.093658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a112d2-3c0d-4c77-85b0-47fc72b75ead None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.095375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 195/392] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:34.101050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.101339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.101607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.119270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:34.120552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:34.248799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862ea80-d5d3-4b77-bfa0-0ec4c377ef8f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.248973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 196/393] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:34.272912 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.294113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.295413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.297460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.297992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.301488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:34.303357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:34.307481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 198/394] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:34 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:34.315445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.370677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:34.413627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:34.448714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb58a4-6941-4507-97d6-6cb99b57fbf4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.502186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.503483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.503974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.504451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.509519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:34.511201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:34.511896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044561a3-597e-4ee2-bbab-9507ddb1878a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.513852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 199/395] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:34 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:34.519304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.552484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.552484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.552484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.552484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.567264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:34.573497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:34.574421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:34.575224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 197/396] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:34.583258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.683074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647438-d4db-44ae-9998-dd36723b601f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.692862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50e05-c7a8-40bb-aaf3-e5cbfb49d2ef None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.696167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:34.734520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.735425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.735821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.736208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.737074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:34.737492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:34.739202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:34.754702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 198/397] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:34.755756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.767973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e4477-5236-4e82-b8de-92336ae505e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.768862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4477-5236-4e82-b8de-92336ae505e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.769146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4477-5236-4e82-b8de-92336ae505e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.769425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e4477-5236-4e82-b8de-92336ae505e3 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c/groups/7592a29e16f04311b06ac4dbf38245a2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.771435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e4477-5236-4e82-b8de-92336ae505e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bebd27c1800f48389399e9b034087b3c, group_id=7592a29e16f04311b06ac4dbf38245a2, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:34.772914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e4477-5236-4e82-b8de-92336ae505e3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:34.855627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:34.856733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 200/398] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 08:52:34 2022] PUT /identity/v3/projects/bebd27c1800f48389399e9b034087b3c/groups/7592a29e16f04311b06ac4dbf38245a2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:52:34.858473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca782c0-0e8c-495a-b18f-6966237bebd8 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.858869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca782c0-0e8c-495a-b18f-6966237bebd8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.861220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58213d-121d-4a17-818a-79ddaf9abff0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:34.863185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca782c0-0e8c-495a-b18f-6966237bebd8 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.865038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 201/399] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:34.872651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fea31-25a6-43ac-8282-5bdec3c544c2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.872965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fea31-25a6-43ac-8282-5bdec3c544c2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.873202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fea31-25a6-43ac-8282-5bdec3c544c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.907082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:34.908379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:34.908763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:34.909235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:34.910687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:34.912489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-839fea31-25a6-43ac-8282-5bdec3c544c2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:34.913114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:34.914262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-839fea31-25a6-43ac-8282-5bdec3c544c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:34.915047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 199/400] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:34 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:34.920785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:34.957259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:35.041990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980e68a-9082-4035-a084-e8c0fba5f340 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.084089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.086040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.086333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.086618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.087961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:35.089524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:35.091307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 200/401] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:34 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:35.097179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.132092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 202/402] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:35.133528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894af25-192b-4020-9185-e4d55a34ddcd None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.133880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894af25-192b-4020-9185-e4d55a34ddcd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.134164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894af25-192b-4020-9185-e4d55a34ddcd None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.135741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 203/403] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:35.142187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.142478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.142743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.160655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:35.161842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:35.217685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:35.227733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb433-5b0c-4d1d-b7c4-19c45ec4bac3 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.246260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 204/404] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:35.247120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.269610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.269610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.269610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.269610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/groups/7592a29e16f04311b06ac4dbf38245a2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.270718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] RBAC: Authorizing `identity:create_grant(project_id=3e696a5f8ab54da484a0c4f3a8408fec, group_id=7592a29e16f04311b06ac4dbf38245a2, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:35.271090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:35.332164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:35.347739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 201/405] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 08:52:35 2022] PUT /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec/groups/7592a29e16f04311b06ac4dbf38245a2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:52:35.348624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.387415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07c021-de95-403d-a6e3-71b1b9d56aed None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.430083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.431996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.432624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.433149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.449717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:35.462595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:35.463576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:35.464355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:35.468460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 205/406] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:35.476490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.492484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d408f7-bdc1-4e35-a946-66fc5bc1ab8b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.532856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.533682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.534066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.534351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.546155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:35.554526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:35.555866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:35.556668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 202/407] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:35.562141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.593730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:35.630699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798369-8aad-4321-bc4b-a9fd338af2b7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.655554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:35.674827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.675537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.675830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.676107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.676861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:35.677169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:35.679572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:35.691048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 206/408] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:35.697732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.735862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0777c5-da5e-474d-bee8-dc1893330a25 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.772713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.773339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.773622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.773894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.774639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:35.774944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:35.784569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:35.798558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:35.799729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.816737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475c836-92bf-4d41-a6f6-533c195922df None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:35.864146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:35.865365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:35.865866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:35.866322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:35.869058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:35.870805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:35.873795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:35.880531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:35.994766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:36.018105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:36.079293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f96a3-000d-4eab-815c-bbe1cb8da3f2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:36.110375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6a6f7-ab0e-408d-8e98-6d7320e32e7d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:36.175876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:36.176766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.177048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.177324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.178611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:36.188503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:36.190398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 208/411] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:36.197765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:36.216511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:36.219651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.220833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.221314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] PATH_INFO: `/v3/groups/7832b07b206542eda14336928e209360` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.222928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] RBAC: Authorizing `identity:get_group(group_id=7832b07b206542eda14336928e209360)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:36.228396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:36.231120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 204/412] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:35 2022] GET /identity/v3/groups/7832b07b206542eda14336928e209360 => generated 229 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:36.248279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:36.412561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9805a8-d1b6-4f63-bc84-9dcc378b4e6e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:36.436134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:36.456125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:36.457132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.457863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.457863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c/groups/7592a29e16f04311b06ac4dbf38245a2/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.460145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] RBAC: Authorizing `identity:create_grant(project_id=bebd27c1800f48389399e9b034087b3c, group_id=7592a29e16f04311b06ac4dbf38245a2, role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:36.461730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:36.497968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f907e75-273e-4747-95c2-0103294eb53a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:36.534538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf668f7-0595-4a3f-b3ad-9d449d6713fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:36.535477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf668f7-0595-4a3f-b3ad-9d449d6713fe None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.535770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf668f7-0595-4a3f-b3ad-9d449d6713fe None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.536054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf668f7-0595-4a3f-b3ad-9d449d6713fe None admin] PATH_INFO: `/v3/projects/4962d1508e764b5186cbd90b7013448e` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.537307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf668f7-0595-4a3f-b3ad-9d449d6713fe None admin] RBAC: Authorizing `identity:get_project(project_id=4962d1508e764b5186cbd90b7013448e)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:36.539439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf668f7-0595-4a3f-b3ad-9d449d6713fe None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:36.541541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 205/413] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:36 2022] GET /identity/v3/projects/4962d1508e764b5186cbd90b7013448e => generated 344 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:36.550338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1bf5-f464-43e2-b600-800d47194d59 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.550338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1bf5-f464-43e2-b600-800d47194d59 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.550338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1bf5-f464-43e2-b600-800d47194d59 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.550578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 209/414] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 08:52:36 2022] PUT /identity/v3/projects/bebd27c1800f48389399e9b034087b3c/groups/7592a29e16f04311b06ac4dbf38245a2/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:36.551813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 206/415] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:36.552160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:36.557407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.557703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.557988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.592611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:36.593865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:36.608319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:36.684945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab3c14-76de-4e6c-8dde-66276f92ae12 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:36.755912 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 207/416] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:36.776546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:36.777225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:36.777525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.777819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.778100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] PATH_INFO: `/v3/projects/4962d1508e764b5186cbd90b7013448e/groups/7832b07b206542eda14336928e209360/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:36.784806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] RBAC: Authorizing `identity:create_grant(project_id=4962d1508e764b5186cbd90b7013448e, group_id=7832b07b206542eda14336928e209360, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:36.786290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:36.835690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 210/417] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 2 08:52:36 2022] PUT /identity/v3/projects/4962d1508e764b5186cbd90b7013448e/groups/7832b07b206542eda14336928e209360/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:36.928074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9a375-5a9d-4c26-8b30-c89a08cec31a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:36.988678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:36.989519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:36.989806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:36.990089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:37.002345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:37.011435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:37.012349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:37.013122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 208/418] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:37.020063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:37.094004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:37.171745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9bda0-8026-4a88-9948-8d6b380a1753 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:37.209582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:37.210345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:37.210632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:37.210974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:37.211833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:37.212155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:37.213597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:37.224780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 211/419] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:37.230489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:37.233767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:37.383058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae6562-4be0-45a8-80f4-d9dd5096fc14 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:37.423974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340648f-dc23-41a3-ace5-c0c2b0837ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:37.424640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340648f-dc23-41a3-ace5-c0c2b0837ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:37.424926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340648f-dc23-41a3-ace5-c0c2b0837ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:37.425202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340648f-dc23-41a3-ace5-c0c2b0837ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:37.519986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340648f-dc23-41a3-ace5-c0c2b0837ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:37.522256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340648f-dc23-41a3-ace5-c0c2b0837ce8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:37.524373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:37.652218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 209/420] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:37.660352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:37.682276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278aff-1bbe-4494-87c8-7db2a6b18dd5 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:37.682574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278aff-1bbe-4494-87c8-7db2a6b18dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:37.682840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278aff-1bbe-4494-87c8-7db2a6b18dd5 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:37.685201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 210/421] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:37.693418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:37.694006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:37.694480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:37.713404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:37.714931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:37.812654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aa90-d0bf-4013-80f2-d6c5c10d7c23 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:37.815542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:37.820840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 211/422] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:37.862034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:37.862911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:37.863200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:37.863507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:37.864703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:37.872687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:37.874722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 212/423] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:37 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:37.880537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:37.887292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:37.935690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:38.009129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d3f61-cf79-43b3-a7ad-08d9697055e9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.074223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.075103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.075413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.075694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.077579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:38.078956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:38.082535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:37 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:38.087973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:38.117205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7aa244-d356-4357-9f5f-e610b4b2156f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.180381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.181105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.181392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.181672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.199915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:38.208735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:38.210136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:38.210908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:38.212032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 213/425] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:38.221708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:38.259612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:38.264598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768364a7-277d-4e2f-945d-c6ee3ab09e6b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.279613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:38.332545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.333221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.333568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.333849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.334868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:38.335190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:38.337878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4439b-287b-4fa3-9634-8c3268681ae0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:38.348630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 213/426] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:38 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 611 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:38.385344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541cd6-888d-4f35-bcdf-5e8f19419257 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.414733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd34f-0ab9-41a0-b09d-d028a9e94e91 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.415179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd34f-0ab9-41a0-b09d-d028a9e94e91 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.415586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd34f-0ab9-41a0-b09d-d028a9e94e91 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.417457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 214/427] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:38.428900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.429331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.429720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.430635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.431396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.431704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.432068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.432958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:38.433283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:38.434817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:38.445378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 214/428] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:38.451713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:38.460839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:38.467547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:38.595131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 215/429] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:38.619908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:38.639445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:38.652260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549680f-aa78-4fff-9720-90a52d7c2a48 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.691004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.691636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.691887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.692169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.726569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:38.734433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763513e-0b4f-4854-ace5-948543baa365 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.770879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:38.772882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:38.774090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.775323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.775845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.776304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.787664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:38.796237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:38.797120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 08:52:38.797916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:38.800625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 216/430] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:38.807190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:38.870477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:38.882847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 215/431] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:38.890784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:38.942261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07434b-365b-4003-8379-a04998bf21eb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:38.987174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:38.992091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:38.992600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:38.993088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:38.994047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:38.994545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:38.997306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.007390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 217/432] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:39.013050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.017886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecaf51-9b37-40d5-a3a6-3280dee98921 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.032794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.055688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.056446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.060692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.060692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.060692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.060692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.065952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:38 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:39.067157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.138184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482dc46-7a2f-4062-8c83-0b8ff19deab8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.148838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.187549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd94c21-73ca-4756-8074-c90a96925466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.188265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd94c21-73ca-4756-8074-c90a96925466 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.188551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd94c21-73ca-4756-8074-c90a96925466 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.188870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd94c21-73ca-4756-8074-c90a96925466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.207199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0608b-3076-47a4-b6a4-1aa04d6a63f0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.249099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93dc49-998d-4fd7-90ea-29435a39b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.249971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93dc49-998d-4fd7-90ea-29435a39b3ee None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.250261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93dc49-998d-4fd7-90ea-29435a39b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.250544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93dc49-998d-4fd7-90ea-29435a39b3ee None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.252014 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93dc49-998d-4fd7-90ea-29435a39b3ee None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.253466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93dc49-998d-4fd7-90ea-29435a39b3ee None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.255094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 217/434] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:39.255094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124a615-872d-44dd-8ef6-5cffe8783b59 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.255094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124a615-872d-44dd-8ef6-5cffe8783b59 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.255094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124a615-872d-44dd-8ef6-5cffe8783b59 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.259360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 218/435] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:39.261528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124a615-872d-44dd-8ef6-5cffe8783b59 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.268036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd94c21-73ca-4756-8074-c90a96925466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.269496 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd94c21-73ca-4756-8074-c90a96925466 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.287744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.380530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124a615-872d-44dd-8ef6-5cffe8783b59 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.390942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 218/436] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:39.390942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a6df-982e-4a8d-b507-3b36cb6264b8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.390942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a6df-982e-4a8d-b507-3b36cb6264b8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.390942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a6df-982e-4a8d-b507-3b36cb6264b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.405436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fba2a6df-982e-4a8d-b507-3b36cb6264b8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:39.406624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fba2a6df-982e-4a8d-b507-3b36cb6264b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:39.412619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.421074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.426722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.426722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.426722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.426722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=bebd27c1800f48389399e9b034087b3c) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:39.426722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.426722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.431289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 219/437] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:39.432290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.505584 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 219/438] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:39.507924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17d96-3180-49b7-a431-09d2ff57c314 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.508410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17d96-3180-49b7-a431-09d2ff57c314 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.509057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17d96-3180-49b7-a431-09d2ff57c314 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.511515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 220/439] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:39.517259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.517543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.517826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.540307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:39.541533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:39.557437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ddaba-4e70-47d4-98a6-01375e3245ca None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.590582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.599012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.600904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.601384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.601837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] PATH_INFO: `/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.603392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] RBAC: Authorizing `identity:get_project(project_id=3e696a5f8ab54da484a0c4f3a8408fec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.604990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.611667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 220/440] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/projects/3e696a5f8ab54da484a0c4f3a8408fec => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:39.611667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.631681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 221/441] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:39.631681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.693684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.736598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eaa849-293a-400c-b0b5-a876fa0e537d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.739370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb1596-fb40-443e-873f-ba4d4473ffc8 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.769605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.770326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.770616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.770896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.773540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.774393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.774672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.774945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.776223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.777588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.779188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 222/442] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:39.779960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.781461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:39.790269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:39.791355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:39.792177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 221/443] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:39.792858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.825134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.878807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb2fef-fcfd-4307-b8e7-3d38a719528e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.895051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dea6b-24a3-438f-83cf-a085af4438f5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:39.910993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:39.912015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.913214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.913495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.913767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.924200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:39.927735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:39.928930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:39.929213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:39.929489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:39.930323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce, scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:39.930638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:39.932120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:39.932763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:39.933597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:39.934388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 223/444] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:39.935028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:39.952230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 222/445] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=3e696a5f8ab54da484a0c4f3a8408fec&role.id=bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:39.952230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.055574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000221-7d7a-4ade-9ba4-b5a6e6888731 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.059139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.065764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25433c9-26b0-44d2-8060-a4babd073aec None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.095450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.096153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.096447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.096735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.097509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:40.097824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.099273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.104438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.105133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.105417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.105701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.106465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:40.106779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.108236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.109797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:40.116165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.127699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 223/447] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:40.129941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.185234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.241780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201c0e4-fd3c-4fff-8853-27dd57090b2e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.248202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297519ec-43e9-455f-aa76-5caa648466b6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.282611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.283317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.283600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.283883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.298315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.298973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.299270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.299553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.323571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.368350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.369819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.380591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.382425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.437581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.482366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 225/448] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:40.490774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.509401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 224/449] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:52:40.515638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.571103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.612465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068fdc1-9858-4ffe-b616-b1480e4e49a2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.646150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4fdd-4375-4957-8398-7e3ac57e977d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.652719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.653662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.653767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.654038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] PATH_INFO: `/v3/projects/bebd27c1800f48389399e9b034087b3c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.655657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=bebd27c1800f48389399e9b034087b3c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.657141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.658872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 226/450] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/projects/bebd27c1800f48389399e9b034087b3c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:40.666890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.688438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.689309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.689588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.689860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] PATH_INFO: `/v3/projects/4962d1508e764b5186cbd90b7013448e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.691056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] RBAC: Authorizing `identity:get_project(project_id=4962d1508e764b5186cbd90b7013448e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.692559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.694330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/projects/4962d1508e764b5186cbd90b7013448e => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:40.699898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.714527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.773202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28345423-1286-4ba9-9f61-8c7f84a21fe3 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.804816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7d5f1-9bbd-4089-ab6d-c80efa9eaad4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.807519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.808401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.808687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.808965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] PATH_INFO: `/v3/groups/7592a29e16f04311b06ac4dbf38245a2` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.810163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] RBAC: Authorizing `identity:get_group(group_id=7592a29e16f04311b06ac4dbf38245a2)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.811659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.813301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/groups/7592a29e16f04311b06ac4dbf38245a2 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:40.818982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.821652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.839101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.839982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.840268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.840542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] PATH_INFO: `/v3/groups/7832b07b206542eda14336928e209360` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.841728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] RBAC: Authorizing `identity:get_group(group_id=7832b07b206542eda14336928e209360)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.843173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.844811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 226/453] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/groups/7832b07b206542eda14336928e209360 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:40.850988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:40.924904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e47359-00c3-41a0-8b67-97e2f932378c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.929953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:40.951564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7355a5-da2b-48bb-9747-1b9c8875fe45 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:40.961700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.962360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.962668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.962947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.963800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] RBAC: Adding query filter params (group.id=7592a29e16f04311b06ac4dbf38245a2, role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=bebd27c1800f48389399e9b034087b3c) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:40.964113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.965542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd0b6c-bb87-4d35-a981-b316db084cdd None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.983284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 228/454] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/role_assignments?group.id=7592a29e16f04311b06ac4dbf38245a2&scope.project.id=bebd27c1800f48389399e9b034087b3c&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:40.984744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:40.985424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:40.985707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:40.985983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:40.986833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] RBAC: Adding query filter params (group.id=7832b07b206542eda14336928e209360, role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=4962d1508e764b5186cbd90b7013448e) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:40.987150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:40.988660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03faea-772f-468c-b5bb-27a2236a5ffb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:40.995961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 2 08:52:40 2022] GET /identity/v3/role_assignments?group.id=7832b07b206542eda14336928e209360&scope.project.id=4962d1508e764b5186cbd90b7013448e&role.id=1824060ea6e647969fbd916218fe88ea => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:43.835670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d3f0-2f71-4a09-8584-88226a2ccd3c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:43.836190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d3f0-2f71-4a09-8584-88226a2ccd3c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:43.836289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d3f0-2f71-4a09-8584-88226a2ccd3c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:43.837851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 229/456] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:43.843286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b133c06-1edb-4b49-a67e-7d25a318f997 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:43.843678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b133c06-1edb-4b49-a67e-7d25a318f997 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:43.843857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b133c06-1edb-4b49-a67e-7d25a318f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:43.868209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6b133c06-1edb-4b49-a67e-7d25a318f997 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:43.869418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6b133c06-1edb-4b49-a67e-7d25a318f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:43.960734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:43.997374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d3f0-2f71-4a09-8584-88226a2ccd3c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.099084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:44.099269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd79d0-6603-4e30-96bb-7bb271ac5e84 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.100273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd79d0-6603-4e30-96bb-7bb271ac5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.100565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd79d0-6603-4e30-96bb-7bb271ac5e84 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.102185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:44.107195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.107525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.107805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.139047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:44.140275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:44.143898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d3f0-2f71-4a09-8584-88226a2ccd3c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.181261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.182434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.182818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.183196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.194306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:44.195949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-e95f8d42-5fbd-4235-8c57-d1d208075ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:44.219417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:44.220313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 230/460] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264618a8-0318-4830-a91c-ddecdbe3275b None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264618a8-0318-4830-a91c-ddecdbe3275b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.221117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264618a8-0318-4830-a91c-ddecdbe3275b None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.221600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 230/460] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:44.225417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.225536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 231/461] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:44.236651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.237069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.237357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.244055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:44.256886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:44.258099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:44.333056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 232/462] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:44.334550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.382611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a955f-b77d-4b7d-8149-7281ff68fbd1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.392193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:44.425912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.426571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.426862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.427146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.427962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:44.428274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:44.429972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:44.450877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6e2eb-0ac8-4fdb-abb6-2adbe3f94622 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.454010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 231/463] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:44.454791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.498891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.500384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.500850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.501299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.514878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:44.517305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:44.522520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:44.541004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:44.542552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:44.543404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:44.543404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:44.543404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:44.543404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:44.544483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 233/464] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:44.549649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.578035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407d1b-62d3-493b-86ad-8b1d091e5c81 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.629476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.630228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.630512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.631331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.644935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:44.646383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:44.664058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:44.664410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:44.665200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:44.666027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:44.666027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:44.666027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:44.666027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:44.666027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 232/465] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:44.671364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.678315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867043b-1b1b-4da4-af83-9ff8e5ec2b19 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.717574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.718329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.718618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.719001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.719770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:44.721263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:44.815264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 234/466] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:44 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:44.815264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.914945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6083-45df-4c9b-8909-d383b2db58d0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.933812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:44.951440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fee76-5ac2-4a2a-bece-b160e508386a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:44.956510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.957524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.958034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.958494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.959512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:44.960011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:44.961632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4c1ec-3d96-4c01-affd-de86dc2e0847 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:44.976480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 233/467] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:44.978241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c96d-cf79-4189-bfad-b649a953220c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:44.978763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c96d-cf79-4189-bfad-b649a953220c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:44.979222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c96d-cf79-4189-bfad-b649a953220c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:44.980895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 234/468] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:44.986600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c96d-cf79-4189-bfad-b649a953220c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:44.999065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:44.999949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.000312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.000687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.001519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:45.002154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.004025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007cd6-93f9-423d-a6c7-7aecb3c64ace None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.023352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 235/469] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:45.024973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.025339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.025688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.044468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:45.045778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:45.062324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:45.117177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c96d-cf79-4189-bfad-b649a953220c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:45.128854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 236/470] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:45.129772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:45.157807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:45.158731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.159185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.159722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.160732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.162556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.219186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 235/471] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:44 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:45.225062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:45.277728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effff1b5-7f11-4ba6-a6e5-9041f606e070 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:45.323654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:45.341880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8efed-ba2a-4793-9c77-78d3c5c698b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:45.342569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8efed-ba2a-4793-9c77-78d3c5c698b7 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.342851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8efed-ba2a-4793-9c77-78d3c5c698b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.343124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8efed-ba2a-4793-9c77-78d3c5c698b7 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.344537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8efed-ba2a-4793-9c77-78d3c5c698b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.346667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8efed-ba2a-4793-9c77-78d3c5c698b7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.398288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f539-7d0e-49d5-b5a0-912ecd5ecbd4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:45.435852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:45.436674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.436959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.437237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.446786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 237/472] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:45 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:45.448763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e954-5da5-43b6-8386-cf3f18e7786b None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.449281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e954-5da5-43b6-8386-cf3f18e7786b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.449772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e954-5da5-43b6-8386-cf3f18e7786b None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.450785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.451341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 238/473] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:45.452804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.458139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.458432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.459536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.466618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:45.484060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:45.484928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:45.485858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:45.485858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:45.485858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:45.485858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:45.487732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 236/474] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:45.491597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:45.491597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:45.494729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:45.572746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 239/475] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:45.604325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:45.610082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:45.622432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4727-8776-4633-b18a-4774f5350d5a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:45.680315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df474c2c-06ae-4179-820a-145568526592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:45.681145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df474c2c-06ae-4179-820a-145568526592 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.681525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df474c2c-06ae-4179-820a-145568526592 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.682153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df474c2c-06ae-4179-820a-145568526592 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.683454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df474c2c-06ae-4179-820a-145568526592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:45.683866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df474c2c-06ae-4179-820a-145568526592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.685342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df474c2c-06ae-4179-820a-145568526592 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.700407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 237/476] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:45.705782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df474c2c-06ae-4179-820a-145568526592 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:45.749585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5bcd0-a7c2-4eea-aa23-e528b44bb293 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:45.783878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:45.789349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:45.790035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.790321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.790602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.792043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.793464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.821434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df474c2c-06ae-4179-820a-145568526592 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:45.851113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.sql.core [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 08:52:45.851113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 08:52:45.851113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [parameters: {'id': '80ef6722ad464b14b9e4e1e6a1331547', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 08:52:45.851113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80266) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 08:52:45.858776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:45.859574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:45.859857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:45.860179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:45.860939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:45.862405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application conn.query(q) Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application result.read() Jun 02 08:52:45.875783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 08:52:45.876979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application next(self.gen) Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application yield resource Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application next(self.gen) Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise self.value Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application session.commit() Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 08:52:45.878204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self.session.flush() Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application compat.raise_( Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 08:52:45.879376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 08:52:45.880214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application conn.query(q) Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application result.read() Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 08:52:45.881093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [parameters: {'id': '80ef6722ad464b14b9e4e1e6a1331547', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:45.881855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 08:52:45.887059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:45.889136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 240/477] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 08:52:45 2022] POST /identity/v3/roles => generated 144 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:45.889136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:45.940112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:45.947545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 238/478] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:45 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:52:46.012913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd27b-9096-41a2-915e-6ad50b2b1a8e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:46.052158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872350c-6918-4e56-a458-2be0eb21b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:46.053897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872350c-6918-4e56-a458-2be0eb21b516 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:46.054505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872350c-6918-4e56-a458-2be0eb21b516 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:46.054982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872350c-6918-4e56-a458-2be0eb21b516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:46.066634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872350c-6918-4e56-a458-2be0eb21b516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-8872350c-6918-4e56-a458-2be0eb21b516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:46.075817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:46.076791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 08:52:46.077576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:46.080591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 241/479] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:46.087297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:46.238234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c55aa-f63e-4c99-a2a3-4e0e16c16578 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:46.280240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:46.280848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:46.281137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:46.281416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:46.282172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:46.282482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:46.283922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63e134-8294-45af-9853-01b20de1162f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:46.293056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 239/480] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:47.393648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57132463-eb63-40b5-8e18-9940b564d3cb None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:47.394161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57132463-eb63-40b5-8e18-9940b564d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:47.394234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57132463-eb63-40b5-8e18-9940b564d3cb None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:47.395851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 242/481] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:47.401881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:47.402273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:47.402452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:47.432622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:47.433830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:47.499171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:47.510564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 240/482] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:47.554035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57132463-eb63-40b5-8e18-9940b564d3cb None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:47.624454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:47.685095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57132463-eb63-40b5-8e18-9940b564d3cb None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:47.730689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:47.731525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:47.731813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:47.732092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:47.748539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:47.757464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:47.758415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:47.759245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 243/483] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:47.766608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:47.900898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e04f02-39c9-4da3-bde6-21c71831c888 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:47.956201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:47.956806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:47.957091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:47.957367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:47.958134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:47.958445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:47.960400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32108c-493d-4c03-afda-e4ca1559af62 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:47.973796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 241/484] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:47.979451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.109686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361af3b-0c33-4dbe-a1ea-9b8d85ef3623 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:48.128559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:48.155797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bdf1c-f7ae-4bfe-aef9-1e8d711f3969 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.156101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bdf1c-f7ae-4bfe-aef9-1e8d711f3969 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.156360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bdf1c-f7ae-4bfe-aef9-1e8d711f3969 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.157763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 242/485] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:52:48.163136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.163457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.163740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.164781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:48.165587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.165877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.166146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.185489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:48.186962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:48.191493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:48.192676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:48.215162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:48.216008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:48.216832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:48.216832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:48.216832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:48.216832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:48.216832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 244/486] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:48.224121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.287823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:48.311426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 243/487] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:48.347115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.398065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece059-3f99-4f32-9759-656fb593dd5a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:48.442843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:48.444379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.444379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.444656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.445537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:48.445853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:48.447789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:48.462095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:48.466997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.502734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:48.525824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc213-3f9b-407a-bd2a-b22fcff5fe67 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:48.561393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bcfdb-f0eb-41cb-b3db-e0f03a00d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:48.562307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bcfdb-f0eb-41cb-b3db-e0f03a00d21a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.562614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bcfdb-f0eb-41cb-b3db-e0f03a00d21a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.562887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bcfdb-f0eb-41cb-b3db-e0f03a00d21a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.577128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bcfdb-f0eb-41cb-b3db-e0f03a00d21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:48.579067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175e23d-6d03-406f-b538-49c3de735d91 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-159bcfdb-f0eb-41cb-b3db-e0f03a00d21a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:48.586726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:48.587654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:48.588560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:48.589715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2b5a-5671-41cb-b573-2115dee165be None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.590072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2b5a-5671-41cb-b573-2115dee165be None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.590363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2b5a-5671-41cb-b573-2115dee165be None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.591971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 245/490] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:48.593629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2b5a-5671-41cb-b573-2115dee165be None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.651090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:48.722763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2b5a-5671-41cb-b573-2115dee165be None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:48.760613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:48.761838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.762262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.762675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.767820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:48.768826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.769206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.769561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.770476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:48.770866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:48.772337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:48.772892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a624c15-d75e-4d27-9b62-427b13f0f882 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:48.774312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:48.784639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:48.786167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.786463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.787327 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:48.793770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:48.794730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:52:48.795650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:48.798663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:52:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:48.799909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.809138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:48.810458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:48.900908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:48.911264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 247/493] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:48.911264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:48.942591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06a3f3-a00d-4925-8c52-5f77bad6d5db None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:48.946087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:48.988866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:48.990757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:48.991359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:48.991850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.005245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.007651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:49.033411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:49.034315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:49.035415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:49.035415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:49.035415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:49.035415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:49.035648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc9f64-03f2-43ed-82bc-2b575f1fefc4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.038153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 247/494] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:49.039262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.071381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.072113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.072450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.072677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.073519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:49.073831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.075378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.113365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 248/495] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:52:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:49.114296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.149907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2715-3954-4be5-89a5-743c809fe578 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.182724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.183549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.183839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.184115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.193109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.197120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:49.204733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:49.205759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:49.206564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 248/496] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:49.207209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.212407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.219012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e039488-21b6-4281-a4a2-84b4dc991d06 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.253234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.253831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.254120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.254406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.255147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:49.256452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.258267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fca53f-791e-4428-97f1-2910409186e7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.270093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:49.272832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55704-d61d-4373-ad38-d74be127340c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.273134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55704-d61d-4373-ad38-d74be127340c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.273419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55704-d61d-4373-ad38-d74be127340c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.274857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 250/498] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:49.276726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed60f6-7d14-4ad1-b3d0-5c13a5d4f963 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.277027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed60f6-7d14-4ad1-b3d0-5c13a5d4f963 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.277308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed60f6-7d14-4ad1-b3d0-5c13a5d4f963 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.279484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 251/499] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:49.280192 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed60f6-7d14-4ad1-b3d0-5c13a5d4f963 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.308222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2190e-a3d1-4592-8b02-6cef47571f84 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.341725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53927-951e-4cac-aad7-41cd2a027c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.342376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53927-951e-4cac-aad7-41cd2a027c16 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.342654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53927-951e-4cac-aad7-41cd2a027c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.342930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53927-951e-4cac-aad7-41cd2a027c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.381493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed60f6-7d14-4ad1-b3d0-5c13a5d4f963 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.408350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.410452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf53927-951e-4cac-aad7-41cd2a027c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.412566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf53927-951e-4cac-aad7-41cd2a027c16 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.418233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.418906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.419194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.419505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.420317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:49.420648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.422015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.431648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 252/500] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:49.432448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.453649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.510718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 249/501] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:49.511999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29cdf-9e3e-42fe-95a5-fec383aa2629 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.512287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29cdf-9e3e-42fe-95a5-fec383aa2629 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.512562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29cdf-9e3e-42fe-95a5-fec383aa2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.528403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8ae29cdf-9e3e-42fe-95a5-fec383aa2629 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:49.529585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8ae29cdf-9e3e-42fe-95a5-fec383aa2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:49.538853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719593b-b3db-456e-84d7-0ef2c7b3e789 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.572204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.573007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.573286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.573559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.580548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.581999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.594979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 250/502] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:49.596344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.596642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.596920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:49.598158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:49.598992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:49.599962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:49.600496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.615623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:49.616808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:49.640644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.678688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.684766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 251/504] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:49.685480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.714240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67c438-529c-4d88-9ad6-6f9f52c1f805 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.749520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.750307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.750589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.750859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.761187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.762584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:49.780284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:49.781121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:49.781960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:49.781960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:49.781960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:49.781960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:49.781960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 254/505] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:49.782213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.798364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de3c1-7a6a-4eae-8ffe-122025c683b1 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.833305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.834809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.835099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.835405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.845552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.847022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:49.864286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:49.865185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:49.870551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:49.870551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:49.870551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:49.870551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:49.870551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 252/506] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:49.870551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.881042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011cdd5-3c18-4a63-b6fb-e5a3fab4f0e6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:49.881160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.907096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:49.915082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:49.915799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:49.916081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:49.916360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:49.917198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:49.921308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:49.921308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:49.937997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 255/507] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:49.938830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:49.968447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff05b-bad8-476e-841d-f0a9023dd031 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.002348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.003145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.003461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.003737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.019428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:50.027310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:50.028206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:50.029003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 253/508] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:50.029649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.045922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2847bbb-2a58-43cc-8491-03aba3f93c50 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.080592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.081391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.081679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.081961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.091911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.093363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.100935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:50.111334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:50.118670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:50.119770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:50.119770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:50.119770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:50.119770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:50.119770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 256/509] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:50.119770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.138907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4ea4-3c90-48e5-ba4f-58f5ffd39d1a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.153081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.171477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.172146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.172436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.172717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.173436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:50.173749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.175182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.187986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 254/510] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:50.188783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.212272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e923c4-fa54-4e14-a12a-5e3227baaa5c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.245714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.246371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.246660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.246941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.247699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:50.248010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.249385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.261524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 257/511] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:50.262316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.290763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3d82-aa13-43fb-803b-2d2c9e36d3ca None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.319865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.324631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.325346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.325684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.325961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.366159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.370443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6559fa-6959-405e-9627-e7a1fbcfa288 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.394279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.395776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.403010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05865a-5143-493b-8255-925950f91182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.403709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05865a-5143-493b-8255-925950f91182 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.403990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05865a-5143-493b-8255-925950f91182 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.404265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05865a-5143-493b-8255-925950f91182 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.405008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05865a-5143-493b-8255-925950f91182 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:50.405316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05865a-5143-493b-8255-925950f91182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.406670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05865a-5143-493b-8255-925950f91182 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.414925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 258/512] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:50.419447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05865a-5143-493b-8255-925950f91182 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.496258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 255/513] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:50.497101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.516553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05865a-5143-493b-8255-925950f91182 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.526476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.549539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.550136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.550422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.550700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.551449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:50.551756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.553676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.565628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 259/514] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:50.566437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.587095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.594431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26185b8-5f87-4290-b88f-c9296360d1a9 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.628507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.629291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.629568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.629839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.636662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.638097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:50.652782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:50.653663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:50.654733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 256/515] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:50.655474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.673462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd166-969c-4453-90a6-a4fc1bf7882c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.706519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.707334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.707617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.707890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.714956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.716454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:50.730921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:50.731942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:50.732781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 260/516] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:50.733454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.750857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.759764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840e99-0430-4073-b542-85531dba00bc None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.794044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.794839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.795126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.795433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.805362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.806842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.812646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:50.824202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:50.825055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:50.825910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:50.825910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:50.825910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:50.825910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:50.825910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 257/517] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:50.826340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.831968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7ea11-25ca-48be-87d5-ecec76683ac9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.866848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.867679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.867967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.868244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.879670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.881682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:50.898682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:50.899621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:50.900427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:50.900427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:50.900427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:50.900427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:50.900427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 261/518] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:50.900690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:50.934750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc1cc-eeb5-47ab-b210-d327541164cb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:50.969787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:50.970456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:50.970740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:50.971017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:50.971757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:50.973195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:50.999917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc507f-6260-432a-bb99-ccdcf1b4a9dc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.028510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.033232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.033906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.034171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.034443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.035300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:51.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.037637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.045597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.050119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 258/519] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:52:50 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:52:51.053713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.054706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 262/520] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 08:52:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:51.055647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.169540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708062-5e71-4ef2-ba15-edae53529409 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.176118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd581056-f8df-48f6-832d-459e9aded078 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.211182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.211896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.212185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.212466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.213323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:51.213583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.214469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.215048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.215144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.215457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.215738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.216477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:51.216783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.218183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.235402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 263/521] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:51.236005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 259/522] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:51.236204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.236850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.296091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.311143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.349329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a5180-9a97-411f-9fe7-bbfa8d975e13 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.354451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f21e96-1f2c-45f3-bf3e-33e223c11692 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.385308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.385985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.386276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.386560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.387351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:51.387666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.389058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.393562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.394507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.394978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.395460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.401697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 264/523] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:51.402444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.469656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.471302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.507826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2668-df97-4550-84fb-d369c4275006 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.519206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.533936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.544022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.544834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.545117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.545398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.554565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.556069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:51.571898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:51.572969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 08:52:51.574207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:51.579398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 265/524] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:51.580350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.584935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 260/525] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:51.585721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.691738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a7d29-2ba1-4242-882b-39e60eca6c86 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.692454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ca13-85a9-4549-8765-a47637146a16 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.727126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.727836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.728126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.728226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.728416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.728949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.729231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.729337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=7d7ba842465543478b83e1bf3c018223) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:51.729504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.729598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.730960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.736235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.736741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 266/526] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/role_assignments?user.id=7d7ba842465543478b83e1bf3c018223&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:51.737364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.744817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:51.768238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:51.769149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:51.769966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:51.772543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 261/527] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:51.773752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.788139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.810736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:51.871642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728e684-5f8c-4350-bcca-2d7e47054f1e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.912362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.913251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.913728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.914223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.915317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:51.915740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.917328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.918498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e9132-f6b8-486f-9ef5-ff57817ba474 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:51.939450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 267/528] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:51.940545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:51.961278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:51.962332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:51.962763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:51.963183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:51.974391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:51.976199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:51.994791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:51.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:51.996605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:51.996605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:51.996605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:51.996605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:51.998855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 262/529] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:51.999847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.046749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.056152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c244f-67d2-4ec6-ba87-7dbdbe2944c4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.094982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.098752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.099755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.100264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.100744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.101750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:52.102323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.104094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.125059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 268/530] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:52.125997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.136471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5873-77c7-42ff-947e-96c066b54c4b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.186728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.187816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.188775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.189258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.246470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b03f-17e1-45cc-ac20-311b5eace63d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.279375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.281498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.296779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.297907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.298742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.299529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.300467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:52.301087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.303527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.325067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 269/531] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:52.326342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.346071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.369216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.407730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 263/532] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:52.408597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.447951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6ef49-5e97-414b-970e-3f96082f290b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.483172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.483879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.484165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.484446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.485279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=3e20e0dbc56e48299b586a3b33c0767d) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:52.485593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.487026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.493113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 270/533] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/role_assignments?user.id=3e20e0dbc56e48299b586a3b33c0767d&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:52.493989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.542218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70cad-6d46-4391-ada4-e6ffe5ebb4fc None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.580793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.605331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e744-3561-41e0-b4b7-160120ac045f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.611950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.613072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.613559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.614034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.621874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.623639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.651278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.651278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.651278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.651278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:52.656345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:52.657144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:52.658019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:52.658435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.658435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.660328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 264/534] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:52.676890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:52.687720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:52.688612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:52.689442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:52.689442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:52.689442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:52.689442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:52.689442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 271/535] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:52.696241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:52.752411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.857855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cab9b9-7621-4333-a58b-a52f7cd3a30c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.912896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb79b-7d9a-4c0e-9d81-a7bb4fe4e8d9 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:52.915584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:52.932319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:52.933022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:52.933309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:52.933591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:52.934350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:52.934664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:52.938483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:52.955498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 272/536] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:52.964354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:53.003443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:53.004121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.004497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.004779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.012592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:53.012922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:53.014379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:53.043684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 265/537] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:53.049659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:53.084356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d752-60b7-4a66-83ce-ff540ed821ea None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:53.136102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:53.136929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.137217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.137497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.150716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:53.152228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:53.172546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:53.173406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:53.174222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 273/538] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:53.179258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:53.236184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:53.241513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:53.253206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4fbbd-368b-4533-a131-5a058ffabb3c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:53.296369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:53.297195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.297484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.297857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.298747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=4091c55281ef4eeb8f2c4e9d84b2fe1f) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:53.299065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:53.300580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:53.300811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cb222-64bc-476e-971f-e9292c181615 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:53.315109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 266/539] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:53 2022] GET /identity/v3/role_assignments?user.id=4091c55281ef4eeb8f2c4e9d84b2fe1f&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:53.345568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:53.346262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.346549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.346830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.347664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:53.347980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:53.349464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d49bf-cc83-440f-8cec-105659ee5e24 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:53.370343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 274/540] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:53.376152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:53.523414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8beea-d557-4c3e-87c8-e9c00f9ac5b4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:53.571437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:53.572197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.572469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.572752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.573730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=29b8fa2fe2d046dcadd150265b166d56) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:53.573896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86353c-a035-4e6e-ab0b-548f50ad60e4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.574043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86353c-a035-4e6e-ab0b-548f50ad60e4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.574190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:53.574342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86353c-a035-4e6e-ab0b-548f50ad60e4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.575470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:53.575877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 275/541] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:53.581125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.581809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.581809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.582175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 267/542] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:53 2022] GET /identity/v3/role_assignments?user.id=29b8fa2fe2d046dcadd150265b166d56&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:53.610668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:53.611934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:53.719741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 276/543] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:53.761807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:53.791380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:53.881274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074a128-1d84-4788-81c0-45a09ab3dc03 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:53.920978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:53.921811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:53.922103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:53.922386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:53.943857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:53.952272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:53.953136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:53.953917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 268/544] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:53.959513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.028303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:54.115616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a6441-c6ee-408b-b0fa-4d69a2820ed0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:54.165804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:54.166479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.166766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.167041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.167821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:54.168129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:54.169509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d909-c684-48d2-a299-fef19601f73a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:54.182744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 277/545] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:54.188135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.288042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:54.288220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111aba3-0e90-4f71-a8c3-862e8a468afb None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.288464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111aba3-0e90-4f71-a8c3-862e8a468afb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.288645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111aba3-0e90-4f71-a8c3-862e8a468afb None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.290259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 278/546] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:54.295323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.295616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.295896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.314165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:54.315263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b23908-e712-4d58-8e39-4047cda831ec None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:54.315457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:54.379172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:54.379999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.380797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.381079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.402142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:54.403633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:54.435924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:54.436812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:54.437640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:54.437640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:54.437640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:54.437640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:54.437640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 269/547] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:54.444931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.448825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 279/548] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:52:54.518331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.572537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:54.620564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b1763-de22-4f5d-b54a-ed87b9a90fb5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:54.660992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:54.661640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.662503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.662894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.663713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:54.664034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:54.665534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:54.675579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:54.678959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 270/549] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:54.684192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.706596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef8de2-99f1-4409-a319-2bd9d626648b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:54.788801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:54.789002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642beaa-db82-450a-be15-7b7a6cd4c171 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:54.790251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.790728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.791263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.814425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:54.831260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:54.831260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:54.831260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:54.831260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:54.832227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:54.833060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:54.834438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:54.835082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:54.835641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:54.837527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 280/550] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:52:54.842861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:54.850552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:54.851666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:54.852597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 271/551] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:52:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:54.857362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:54.917178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:54.983717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934fd4-801e-4b82-a620-7373efa381d2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.032668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:55.047465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7dfb8-b479-43f2-b765-6af4e643a957 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.057500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.058188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.058479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.058756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.059633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:55.059945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.061389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.102210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.102884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.103169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.103476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.104229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:55.104538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.105920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.114603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 281/552] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:55.128984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.130863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 272/553] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 08:52:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:52:55.144175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.295348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37a74-cde6-4732-9a09-7bdb2e84cb33 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.327702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157bc9d-a7e9-4e3f-948f-1f109feee211 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.339225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:55.343860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.344809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.345236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.345529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.358027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.360046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.366246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664d10-c185-4041-a1a3-7458e3d3b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.366908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664d10-c185-4041-a1a3-7458e3d3b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.367193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664d10-c185-4041-a1a3-7458e3d3b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.367508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664d10-c185-4041-a1a3-7458e3d3b7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7e747994-022b-4613-8804-2a2aa962a42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:55.388799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:55.389676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:55.390523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:55.390523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:55.390523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:55.390523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:55.390523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 282/554] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:55.392240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c71f-daf4-40d1-96a4-7633d38ab830 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.392517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c71f-daf4-40d1-96a4-7633d38ab830 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.393089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c71f-daf4-40d1-96a4-7633d38ab830 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.399307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 283/555] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:55.400534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c71f-daf4-40d1-96a4-7633d38ab830 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.406648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:55.447716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664d10-c185-4041-a1a3-7458e3d3b7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.449193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664d10-c185-4041-a1a3-7458e3d3b7b1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.544238 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c71f-daf4-40d1-96a4-7633d38ab830 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.582302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.582302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.582302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.582302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.582756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:55.582756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.584313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.588345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 273/556] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:52:55.592609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.593124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.593616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.603537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 284/557] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:55.604655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.639789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:55.641879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:55.645764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:55.698560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:55.738651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 274/558] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:55.740613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.755746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ea086-3f52-40d5-a3f4-5784c1c660b6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.804222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.805515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.805636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.806001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.817247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.818907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:55.838294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:55.839914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:55.841008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:55.841008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:55.841008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:55.841008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:55.841844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 285/559] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:55.847411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.881563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f82b97-4d4e-483a-91cb-8d7e98684346 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.937962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:55.939409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:55.940786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:55.941303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:55.951654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:55.954304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:55.957943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:55.972407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5740-b407-4526-a8a6-7b9adc2679be None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:55.979406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:55.980368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:52:55.981291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:55.987257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 275/560] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:55.987257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:55.996774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.020608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.022782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.023041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.023336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.038146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:56.048326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:56.050693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 286/561] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:56.052330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.104595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dd909-51db-416e-af8b-e5da64e70e84 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.139173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.139871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.140157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.140437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.141162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:56.141473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.142863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.158734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 276/562] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:56.158734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.168376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02746e82-bf75-4c80-af65-49b26467af6d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.206907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.207728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.208016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.208323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.209174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:56.209486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.210924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571df0-05c5-449c-9db6-86f5f32905bf None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.217348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.228355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 287/563] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:56.229611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4790-e83e-4166-9edb-68d1a543c1dc None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.229898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4790-e83e-4166-9edb-68d1a543c1dc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.230175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4790-e83e-4166-9edb-68d1a543c1dc None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.235213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 288/564] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:56.235213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e4790-e83e-4166-9edb-68d1a543c1dc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.260332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281076b1-8dce-43a7-abcd-96b00ee725aa None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.271554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.293948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.294663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.294951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.295248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.295996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:56.296303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.297681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff13f-2701-4ac6-99a4-0be8cc4b0b91 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.306108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 277/565] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:56.307412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49850198-2d81-42b9-8284-af399270d8ec None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.307705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49850198-2d81-42b9-8284-af399270d8ec None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.307984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49850198-2d81-42b9-8284-af399270d8ec None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.309679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 278/566] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:56.309910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49850198-2d81-42b9-8284-af399270d8ec None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.340990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e4790-e83e-4166-9edb-68d1a543c1dc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.374345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.375130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.375437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.375720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.382379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.383861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-779aacae-5b54-42d9-ae43-d45f98a8a651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:56.400313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:56.401275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:56.402131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 289/567] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:56.405125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563758a-d0d2-4d7a-bfda-6a2adc481b34 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.405408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563758a-d0d2-4d7a-bfda-6a2adc481b34 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.405682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563758a-d0d2-4d7a-bfda-6a2adc481b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.414226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49850198-2d81-42b9-8284-af399270d8ec None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.423420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1563758a-d0d2-4d7a-bfda-6a2adc481b34 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:56.424601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1563758a-d0d2-4d7a-bfda-6a2adc481b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:56.436941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.448246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.449039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.449326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.449612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.460577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.462193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:56.480684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:56.481710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:56.482577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:56.482577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:56.482577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:56.482577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:56.482577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 279/568] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:56.482859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.494196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 290/569] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:56.495569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.495861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.496164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.513261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:56.514438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:56.531869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.581264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 291/570] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:56.582313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.587334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd2298-299b-4551-937b-36937b0aa32c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.622535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.623354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.623642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.623918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.634490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.635910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:56.653082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:56.654399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:56.655672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:56.655672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:56.655672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:56.655672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:56.655672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 280/571] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:56.655672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.683354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c189cd-9d13-4056-a7db-a26e210e9d31 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.684645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.720585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.721252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.721541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.721814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.722597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:56.722908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.724986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.736179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 292/572] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:56.736965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.754149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.757183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736c1fa-2978-4b68-87e7-2d198261ecdb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.790986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.791686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.791973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.792255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.792972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:56.793285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:56.794667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:56.806248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 281/573] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:56.807109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.840877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cccd6-aea6-4f32-bf5b-bc458c741ca8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.873551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.874345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.874628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.874907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.885822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:56.892277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:56.893544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:56.894504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:56.895373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 293/574] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:56.896583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.908800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d97f7a-7f10-4f08-991d-1382d858c81a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:56.947516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:56.948324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:56.948618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:56.948897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:56.959639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:52:56.967418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:56.968315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:56.969133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 282/575] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:56.970228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:56.970623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:56.998371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb585-3566-4710-a7c2-d3b65e7e745b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.035024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.035721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.036001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.036276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.037733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:57.038042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.039439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.051570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 294/576] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:57.052528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.073516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebdf4c-fee4-480c-bd46-74ed19076c46 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.106455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.107111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.107428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.107707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.108532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=35b1d5f68be34afc8a72843e869bc3b2) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:57.108845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.110290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.115833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 283/577] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:52:56 2022] GET /identity/v3/role_assignments?user.id=35b1d5f68be34afc8a72843e869bc3b2&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:57.116604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.131471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.159069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee80d-78f0-4bf5-b5bf-7d49f6ef0d80 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.198436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.199300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.199573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.199846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.202251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.209643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.211802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:57.227609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:57.228576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:57.229460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 295/578] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:57.229951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.246309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853edc5d-23c4-4d44-b236-585d4852d81e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.285662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.286704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.287072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.287358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.288119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:57.288424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.290358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.299449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 284/579] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:57.300293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.343036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f007b-1247-45cb-8e56-d2742af69398 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.377986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.378663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.378961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.379260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.380039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:57.380870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.382284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.385028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.390622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 296/580] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:57.391466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.415946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846a4d-9d5b-4e72-bd27-824d2a66be7f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.452826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.455026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.455872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.456156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.456563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.465720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.467994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:57.487445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:57.488402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:52:57.489434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:57.490495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 285/581] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:57.495717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.497841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7889a61-a74c-4da9-9dd0-a660dfcf32de None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.533472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.534134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.534437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.534697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.535499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:57.535811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.537857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.554724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 297/582] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:57.554724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.620625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5050e-c225-435f-b87f-36e57399f98a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.653015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.655579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646de63-003b-4b77-88f9-c54a7a70757b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.659922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.661312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.667286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.667286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.673429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.674909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.676437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.692012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.695967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.695967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.695967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:57.696194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:57.701808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:57.702911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:57.702911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:57.702911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:57.702911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:57.702911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 286/583] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:57.702911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.712863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.714455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:57.733924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:57.734774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:57.735711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:57.735711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:57.735711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:57.735711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:57.735711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 298/584] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:57.735980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.818592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dd75e-a4c5-4b95-bfa9-7eb3dd3a51fa None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.840797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad55ab-c203-46f9-8b7c-3e9fc4fd1032 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:57.854590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.855288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.855866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.855866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.856658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:57.857016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.858414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.878685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:57.879628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:57.879916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:57.880719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/7d7ba842465543478b83e1bf3c018223/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:57.881367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 287/585] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:57.882208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.895606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=7d7ba842465543478b83e1bf3c018223, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:57.897609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:57.928883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.961451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 299/586] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:57 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/7d7ba842465543478b83e1bf3c018223/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:57.962323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:57.991930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:57.995374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b353-20bb-4407-a1ee-96607264100b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.035952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.037194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.037799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.038089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.038832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:58.039145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.041446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.060171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 288/587] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:58.062008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.096219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086ec7-75c5-4a79-89d2-089a17b91173 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.137708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.138649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.139077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.139584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.140600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:58.141088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.142733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.161159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 300/588] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:58.162958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.174739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d130e-4791-44b3-92a5-62b2649fca65 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.176498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.213221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.214345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.214829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.215321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.227357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.229077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:58.248050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:58.249006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:58.249928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:58.249928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:58.249928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:58.249928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:58.252576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 289/589] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:58.252889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.253733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.281829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6b32-9b19-4fb1-b25d-f29c8f5689e0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.328750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.329817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.330102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.330379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.345437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.347604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.362961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62081f34-3e5b-4b30-a77d-0a444dcec3bb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:58.367360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:58.368342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 08:52:58.369609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:58.373444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 301/590] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:58.374315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.404057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.405105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.405531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.406066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.414400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.416059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:52:58.431572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:58.432729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 08:52:58.433810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:58.435616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 290/591] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:58.436900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.457776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.506348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf20d8-28a5-47a8-ba10-ff666fe97d30 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.558337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438dc5-43e4-4350-b6de-8b471416e9d0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.563928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.564691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.565047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.565400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.566651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:58.567032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.569426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.578799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.589983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 302/592] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:58.589983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.601015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.601982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.602466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.602976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.604060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:58.604574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.606220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.631181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 291/593] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:58.632348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.712131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.718321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0c01-d8fa-4dbc-b4af-d4547dbd072a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.746393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42152aa8-f53c-4385-907a-254cb14ced80 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.766532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.767220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.767538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.767824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.768683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:58.768999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.770999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.785871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.787553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.788066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.788542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.797441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 303/594] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:58.797441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.798288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.799808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:58.819063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:58.820172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:58.821095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:58.823306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 292/595] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:58.824380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.866476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.912412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d845a8e-d717-4785-b901-30fc917e67a5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.950550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.951768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.952223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d891ef1-157c-46f0-8daa-8b22544b598d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:58.952476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:58.952957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:58.964241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:58.966064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:58.984694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:58.985608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:58.986476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:58.987599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:58.987599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:58.987599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:58.987599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:58.989469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 304/596] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:58.991151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:58.992110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:58.993009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:58.993505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.000474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.006939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.009693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:52:59.034010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:59.035100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:59.036039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:52:59.036039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:52:59.036039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:52:59.036039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:52:59.036039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 293/597] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:59.041389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.107174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05844c-2aeb-483b-a252-8e71e6811bd9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.119028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:59.150145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.150989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.151478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.151859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.152757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:59.153195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.154728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.161054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324797b-5b61-4a36-9e04-9886a0eac3f7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.171282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 305/598] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:59.171282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.206930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.208069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.208542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.208992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.209917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:59.210230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.211664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.226666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 294/599] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:59.227578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.280861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:59.293271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb81eb6-15ef-460a-9280-125c20fd5c7c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.335064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.336151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.336663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.337163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.338111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:59.338639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.340287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.343298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258cf7c-5c2b-4600-bc6e-cee652498d45 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.354523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 306/600] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:59.355739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.379645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11dbd-950a-4967-9a6b-47298d9d3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.380580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11dbd-950a-4967-9a6b-47298d9d3d41 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.380865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11dbd-950a-4967-9a6b-47298d9d3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.381145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11dbd-950a-4967-9a6b-47298d9d3d41 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/3e20e0dbc56e48299b586a3b33c0767d/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.387195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:59.396151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c11dbd-950a-4967-9a6b-47298d9d3d41 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=3e20e0dbc56e48299b586a3b33c0767d, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.397655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c11dbd-950a-4967-9a6b-47298d9d3d41 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.460181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429974-503e-45fd-bd24-c168f6aa88cb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.493748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.494477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.494766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.495047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.501958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.503455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:59.517146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:59.518288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 307/601] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:59.519476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.610106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 295/602] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:59 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/3e20e0dbc56e48299b586a3b33c0767d/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:52:59.615744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64d2c-a720-4bfe-aa9a-0756aab7f853 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.621170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d052d6-3705-49ce-bfa5-432638730cfa None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.641438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d052d6-3705-49ce-bfa5-432638730cfa None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.641438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d052d6-3705-49ce-bfa5-432638730cfa None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.641692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:59.641786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 296/603] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:52:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:52:59.641786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d052d6-3705-49ce-bfa5-432638730cfa None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.665136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.666194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.666615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.666959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.674951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.676778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a7e69048-e938-487a-99a5-367bb6885aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:52:59.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:52:59.695447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:52:59.697186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 308/604] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:52:59.698328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.703270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.703270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.719466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:52:59.720914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:52:59.759076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:59.768002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d052d6-3705-49ce-bfa5-432638730cfa None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.809275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.809960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.810245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.810515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.811466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:59.811782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.817935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.818126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 309/605] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:52:59.818126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.839048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 297/606] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:59.840069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:52:59.914049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:52:59.938808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ff1b-6c70-4e3d-b53e-3b13cd4a3230 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.966836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee401-9fa3-4c66-8e07-c9690a2a0df0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:52:59.977013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:52:59.978081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:52:59.978583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:52:59.979077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:52:59.980199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:52:59.980744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:52:59.982458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:52:59.998113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 310/607] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:52:59.999441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.022169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:00.022926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.023377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.023783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.039319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:00.049194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:00.050164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:00.050998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:00.055323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 298/608] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:00.058234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.081916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:00.134954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05a15-f3ed-463a-b133-6755d6594084 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:00.176165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127287e4-f990-4d3e-ad36-5bb0e0c4a702 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:00.183757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:00.185398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.185853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.186281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/4091c55281ef4eeb8f2c4e9d84b2fe1f/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.197947 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:00.208554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=4091c55281ef4eeb8f2c4e9d84b2fe1f, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:00.210420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:00.216286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f7070-8456-4899-9215-a0f4b01978b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:00.220153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7070-8456-4899-9215-a0f4b01978b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.220153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7070-8456-4899-9215-a0f4b01978b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.220153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7070-8456-4899-9215-a0f4b01978b3 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/29b8fa2fe2d046dcadd150265b166d56/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.233804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7070-8456-4899-9215-a0f4b01978b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=29b8fa2fe2d046dcadd150265b166d56, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:00.235288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7070-8456-4899-9215-a0f4b01978b3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:00.318993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 311/609] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:52:59 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/4091c55281ef4eeb8f2c4e9d84b2fe1f/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:00.319941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.383772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 299/610] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:00 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/29b8fa2fe2d046dcadd150265b166d56/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:00.387337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c3e7-b33a-442c-a283-eb1c066973eb None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.387691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c3e7-b33a-442c-a283-eb1c066973eb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.388278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c3e7-b33a-442c-a283-eb1c066973eb None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.391035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 300/611] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:00.397991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.398383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.398674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.432793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:00.434116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:00.530376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990564c2-78cc-419b-a7f3-4afea02e8574 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:00.540783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:00.559789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 301/612] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:53:00.593606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:00.594219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.594588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.594868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.595667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:00.595810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.595976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:00.597478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:00.611398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 312/613] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:00.615164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.678190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:00.726637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a42f3-4c3d-4187-ab4d-634b20c0d526 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:00.746564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c976e4-2a4e-4011-8069-04c445c0ecf9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:00.784607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:00.785407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.785689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.785964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.788507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:00.789339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:00.789613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:00.789887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:00.798230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:00.799873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:00.819661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:00.820615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:00.821484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:00.821484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:00.821484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:00.821484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:00.823867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:00.824788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 313/614] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:00.826689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:00.831893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:00.832820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:00.834247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 302/615] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:00.844267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:00.940079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:01.000207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67af4f-7247-4398-aedf-63025472ffe5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.002328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:01.025261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46dcd6-36d6-465f-b66d-ed06cd7e6119 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.060017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.060699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.060986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.061262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.062019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:01.062325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.063736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.068090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.068831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.069180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.069540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.070337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:01.070648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.072043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.073271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 303/616] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:01.084748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.089116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 314/617] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:01.090952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.237775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463f8d-486a-49fa-ab0b-3592d214d32d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.285469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b07e-6465-429f-bc96-853760edbb22 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.302751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.303810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.304093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.304365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.315575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:01.316380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.318431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:01.338688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:01.339878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:01.340829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 315/618] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:01.344295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.345195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.345482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.345588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.345846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.371476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:01.372726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.374193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:01.407260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:01.408222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:01.409166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:01.409166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:01.409166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:01.409166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:01.411135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 304/619] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:01.416636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.453333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55de4-814d-4232-bca1-e432ae646e80 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.488305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.489049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.499256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.499256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.499256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:01.499256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.499256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.513183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 316/620] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:01.517712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.599258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055e32-3d07-49c1-84b0-4864d6bb1f5b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.632633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:01.667314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73308b33-acc9-4441-b35b-78f724cd87f7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.669279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.669949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.670231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.670503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.671250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:01.671570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.672962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.694055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 305/621] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:01.700663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.730776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:01.731619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:01.731911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:01.732195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:01.744566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:01.746090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:01.765593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:01.766494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:01.767668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:01.767668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:01.767668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:01.767668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:01.767668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 317/622] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:01.772646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:01.773775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:01.929386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074791ce-2325-4640-acff-db6b4373d94c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:01.967670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23b67-a75b-41bc-9cd1-d5fa3e046188 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.004066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.004793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.005672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.005953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.015997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.017455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.027626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.038425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.039096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.039413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.039689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.040425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:02.040733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.044996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:02.050002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:02.050894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:02.052477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 306/623] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:02.057853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.068326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 318/624] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:02.072124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.164708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.177739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86696f-df38-4d31-929f-6f81c1e8d82a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.213888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.214609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.214896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.215170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.216044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:02.216356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.217783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27dc9f-fdef-4ef2-aa61-06f2eeba8e50 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.235614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 307/625] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:02.237127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63998a-571c-4d12-977f-9cfb0824c363 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.237419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63998a-571c-4d12-977f-9cfb0824c363 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.237746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63998a-571c-4d12-977f-9cfb0824c363 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.238109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24587c-ed8e-459e-bea7-e07bf1e7b332 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.239254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 308/626] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:02.243724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63998a-571c-4d12-977f-9cfb0824c363 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.289737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.290523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.290809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.291092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.299975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.301451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-44125806-5f71-464d-b20d-794bc524d72f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:02.323525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:02.324430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:02.325334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:02.328269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 319/627] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:02.329984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.330694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.331122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.354139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:02.356493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:02.366521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63998a-571c-4d12-977f-9cfb0824c363 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.408070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.408482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.408862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.409231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.424308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.426174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.452372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 320/628] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:02.453504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.507169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.508886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.583066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12c43c-d9e1-467f-a296-a5a4a8142adc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.622808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 309/629] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 08:53:02.624118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.630015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.630928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.631392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.631818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.632771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:02.633783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.635429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.654718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 321/630] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:02.656195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.688719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.706943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.768566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230896-00d4-4dd1-b00c-65b0748afabf None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.770107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd063-6309-44b3-a60b-cb62754466fc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.807148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.808082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.808465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.808838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.815995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:02.816972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:02.817495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:02.817963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:02.820306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:02.821914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:02.831886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:02.840227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:02.841316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:02.842409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:02.842409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:02.842409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:02.842409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:02.843406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:02.844433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:02.845362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:02.846165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 322/631] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:02.847028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.848057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 310/632] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:02.849948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:02.969909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a097a1a-d62e-4ca2-abc3-1b09bef2f32e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.972323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:02.980685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63505a-e4a4-4061-b1e2-d979356dcf43 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:02.981578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.013207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.013879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.014165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.014437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.015181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:03.015517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.016905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.024303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7ce15-ea8c-4f63-a6f0-4a8f9e2b083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.024303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7ce15-ea8c-4f63-a6f0-4a8f9e2b083d None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.024303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7ce15-ea8c-4f63-a6f0-4a8f9e2b083d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.024303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7ce15-ea8c-4f63-a6f0-4a8f9e2b083d None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/35b1d5f68be34afc8a72843e869bc3b2/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.032027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 311/633] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:03.032711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.040265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7ce15-ea8c-4f63-a6f0-4a8f9e2b083d None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=35b1d5f68be34afc8a72843e869bc3b2, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.041758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7ce15-ea8c-4f63-a6f0-4a8f9e2b083d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.101790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 323/634] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:02 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/35b1d5f68be34afc8a72843e869bc3b2/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:03.103457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457d3f1-d998-433a-a04a-55c5f5674b1f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.103970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457d3f1-d998-433a-a04a-55c5f5674b1f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.104569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457d3f1-d998-433a-a04a-55c5f5674b1f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.106267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 324/635] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:03.107273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457d3f1-d998-433a-a04a-55c5f5674b1f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.154186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba3de4-0ea3-4342-ab96-26516ce42cf8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.203126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.204216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.204501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.204777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.205539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:03.205847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.208862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc864-7a50-48a2-8692-a7fb462dc0b3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.220666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 312/636] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:03.221573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457d3f1-d998-433a-a04a-55c5f5674b1f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.222034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863e6b-6072-484c-b3a4-700ea1fd5ae3 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.222328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863e6b-6072-484c-b3a4-700ea1fd5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.222604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863e6b-6072-484c-b3a4-700ea1fd5ae3 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.228476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 313/637] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:03.228476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aff82-9dc6-451f-bab9-7462420b65fc None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.228476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aff82-9dc6-451f-bab9-7462420b65fc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.228476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aff82-9dc6-451f-bab9-7462420b65fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.244334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8d2aff82-9dc6-451f-bab9-7462420b65fc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:03.245555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8d2aff82-9dc6-451f-bab9-7462420b65fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:03.266076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.266974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.267284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.267563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.273022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.275918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.277434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:03.292785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:03.293759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:03.294670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:03.295088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 325/638] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:03.295817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.307148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.326232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 314/639] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:03.327614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.327911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.328245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.346354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:03.347666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:03.410874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bddfd7-e2b0-49ed-ad42-47257f7ee31f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.415863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 315/640] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:03.416810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.466444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.467332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.467623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.467901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.480997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.482943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:03.501418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:03.502735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:03.508318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:03.508318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:03.508318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:03.508318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:03.508318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 326/641] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:03.508318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.515027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.531826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31f6d-5b54-4b17-8d2c-8cbd3b434531 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.565730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.570820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.571664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.572009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.572512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.573266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:03.573698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.575268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.592522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 316/642] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:03.592522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.616905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1dbf-17e5-4828-b279-0208bec0a7da None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.653647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.654502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.654906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.655262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.666758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:03.675325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:03.676540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 327/643] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:03.677918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.697909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a4f78-974b-4923-8832-19556f567a6f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.733108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.733990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.734270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.734542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.746706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:03.754813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:03.756468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 317/644] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:03.757359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.769639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.787834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297029bd-71f0-43c5-85ef-55b89ae9fb60 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.807787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:03.825486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.826160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.826451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.826726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.827475 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:03.827788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.829165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.841810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 328/645] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:03.843936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.871714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ae99-d305-44ce-a374-eca1321c13f0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.910759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:03.911975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:03.912292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:03.912530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:03.913533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=7d7ba842465543478b83e1bf3c018223) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:03.913641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:03.915115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:03.931460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 318/646] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/role_assignments?user.id=7d7ba842465543478b83e1bf3c018223&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:03.932518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:03.954539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b97cab-3d2a-4159-b9b3-42e2bf4d2b83 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:03.999090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.000374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.001242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.001954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.003134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:04.003613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.005801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.022915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 329/647] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:04.022915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.033215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.076170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bbed1-7bde-444d-a33d-1e1092cc4359 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.080577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.124316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.125228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.125627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.126006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.127122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:04.127557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.129090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.138302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 319/648] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:04.139205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.171989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa0d4c-c23f-408c-82d1-e45ef5c6f00c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.220525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.221175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.221470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.221899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.238699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.240776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:04.261760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:04.262971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:04.264153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 330/649] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:04.265020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.270801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4529d-a9a7-4d6f-8531-823be0a0f7db None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.311768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.312567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.312851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.313126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.316828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.332170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.335299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:04.359810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:04.360747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:04.361644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:04.361644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:04.361644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:04.361644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:04.364603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 320/650] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:04.369439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.390469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.400415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35b5b-3a75-4529-92f7-6b07aa763d0f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.440748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.441972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.442572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.443127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.455441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.457241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.475824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e8bf-765c-4ef9-b423-aa11e4a760ba None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:04.478053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:04.478884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:04.479786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:04.479786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:04.479786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:04.479786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:04.481695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 331/651] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:04.482842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.515304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.515987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.516274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.516550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.517386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:04.517699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.519217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.538605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 321/652] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:04.539533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.595401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.606295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea73d0-dcb8-4f24-988a-a13be6616505 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.651723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.652575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.652923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.653262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.654054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:04.654425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.654900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc78811-e7d0-4d34-937d-ad3f7c5a37d5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.655955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.675546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 332/653] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:04.676624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.693440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.697730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.698530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.698728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.698950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.699779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:04.700136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.701888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.718820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 322/654] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:04.719830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.810128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086c68-afde-4af6-bc33-e4b99651fcab None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.845503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.846146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.846430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.846708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.857824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2dc2c-bb0e-4022-aef0-6f76975df9c1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:04.860849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:04.894401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:04.894880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:04.895130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:04.895940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:04.905032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.906658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:04.924097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:04.925062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 08:53:04.925988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:04.927559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 323/655] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:04.928392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:04.956219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:04.959271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:04.975497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.041019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b0dcb-91d5-4f09-9378-ed3ede06a3bb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.088968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.089791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.090075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.090357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.099211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.100722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.108247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 333/656] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:53:05.109717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:05.116610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:05.117547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 08:53:05.118473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:05.122484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 324/657] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:05.123190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.150425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.239861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734a89b-6aea-441d-bd6b-ae5ee7348e91 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.240808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1600-dda5-480c-a582-002a645d9fbd None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.252515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.276765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.280193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.280193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.280193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.280193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:05.280193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.280720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.287476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.288797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.289641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.290979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.304407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 334/658] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:05.304987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.305337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.307462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:05.330654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:05.331872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:05.332774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:05.332774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:05.332774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:05.332774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:05.332774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 325/659] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:05.333436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.420329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.422755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6746d-12bd-4110-9479-5a8d65a27dbb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.444039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4a881-8d9e-4e52-a83f-bfe205527a21 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.460551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.461886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.462354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.462787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.463814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:05.464287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.466611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.479450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.480216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.480603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.480980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.490123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 335/660] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:05.490795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.519887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.556091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.557712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.594698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779cdfe-5321-4181-9ccf-cf533a0ce6b7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.635392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.636159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.636296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.637004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.637413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.638252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:05.638744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.640181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e10aa-4ef5-45f2-978c-18d226094563 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.652589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 336/661] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:05.658343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eed72-3ad9-43d4-b7c7-e5b5362543b5 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.658742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eed72-3ad9-43d4-b7c7-e5b5362543b5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.664346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eed72-3ad9-43d4-b7c7-e5b5362543b5 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.664485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 326/662] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:53:05.664485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.664639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 337/663] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:05.664639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eed72-3ad9-43d4-b7c7-e5b5362543b5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.758930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.774640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc703-9d68-4d7d-8abc-80e81b73cf8f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.775962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eed72-3ad9-43d4-b7c7-e5b5362543b5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.810659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb2fc7-3e6b-4db5-a23d-16663252642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.811344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb2fc7-3e6b-4db5-a23d-16663252642f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.811632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb2fc7-3e6b-4db5-a23d-16663252642f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.811903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb2fc7-3e6b-4db5-a23d-16663252642f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.812800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.813563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.813850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.814128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.821111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.822563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:05.837115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:05.838024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:05.838917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 338/664] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:05.839450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:05.866521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:05.891055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb2fc7-3e6b-4db5-a23d-16663252642f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:05.892653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb2fc7-3e6b-4db5-a23d-16663252642f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:05.956822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70dc80-13aa-4921-bfee-8a87cdfebaad None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:05.993579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:05.994313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:05.994785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:05.994904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:05.998585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 327/665] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:53:05.999788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.000080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.000358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.012321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.013730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.019770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:06.021604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:06.022571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:06.038818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:06.040049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:06.040943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:06.040943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:06.040943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:06.040943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:06.040943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 339/666] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:06.041271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.102524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 328/667] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:06.103178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.111423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.163471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178303af-a8b3-4b6d-b4a4-272381a0a094 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.198992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.199686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.199969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.200245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.201026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:06.201592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.202803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.214295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e0e0-6551-44b0-bfa2-ac16d9e408dd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.218247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 340/668] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:06.219309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.252103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.252893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.253172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.253452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.263968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.265356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:06.283401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:06.284302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:06.285169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:06.285169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:06.285169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:06.285169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:06.285420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.285495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 329/669] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:06.285495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.333281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e529f5-d0e7-435a-9f6a-3b60da6c52b1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.353466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.370766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.371458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.371746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.372026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.372755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:06.373065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.374453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.385780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 341/670] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:06.386563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.400214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7b4df-61a1-4898-9432-a3b57fb7b30d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.433499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.434313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.434600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.434880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.445057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:06.452815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:06.453817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:06.454671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 330/671] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:06.455415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.489283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511d76b-bc9e-4c2b-befd-5c84b3409f04 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.505523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.522671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.523327 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.523608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.523884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.524749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=3e20e0dbc56e48299b586a3b33c0767d) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:06.525056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.526516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c42b-b81a-4d1c-a657-9eac266c3a7a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.532725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 342/672] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/role_assignments?user.id=3e20e0dbc56e48299b586a3b33c0767d&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:06.533918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b01f2-da56-416e-8f96-25d3a1c3874b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.534201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b01f2-da56-416e-8f96-25d3a1c3874b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.534478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b01f2-da56-416e-8f96-25d3a1c3874b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.544299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 343/673] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:06.544299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b01f2-da56-416e-8f96-25d3a1c3874b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.561814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97221421-cf70-45b3-a8dc-c3e8eeedb15f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.585489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.606653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.607460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.607742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.608015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.608741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:06.609048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.610445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.624449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 331/674] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:06.625316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.658931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b01f2-da56-416e-8f96-25d3a1c3874b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.697043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.697847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.698130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.698405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.706025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.707537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-96105f6f-205a-4d3d-93eb-1b4a9607aff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:06.724826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:06.725736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:06.726965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:06.729446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 344/675] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:06.730766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.731053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.731376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.745400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccf4fe-2dbd-427c-a8ff-75dc516abdf4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.749715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:06.750901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:06.785409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.786946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.787249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.787539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.788295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:06.788607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.790013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.795182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.798710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 332/676] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:06.799809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.830442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 345/677] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:06.831301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.855816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:06.923691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cab41-9798-489a-a563-7dc81ea93998 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.934837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609cadf-461c-4e51-b915-f689f1b35d53 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:06.961957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.962770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.963057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.963369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.971158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.971730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:06.972394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:06.972667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.972777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:06.972944 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:06.973782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:06.974090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:06.976044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:06.987038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:06.988072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:06.988950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:06.991552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 346/678] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:06.992648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:06.992997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 333/679] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:06.993849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.027296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.103380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715da26-2a46-40f8-a448-c7188abebaa6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.106882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.110066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db9ba4-4505-4089-a737-b69868b9ee4c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.139857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.140656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.140943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.141218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.147222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160830-eb47-468a-a951-74be456e7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.148046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160830-eb47-468a-a951-74be456e7dba None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.148741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160830-eb47-468a-a951-74be456e7dba None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.149023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160830-eb47-468a-a951-74be456e7dba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.152354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.153813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.160067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44160830-eb47-468a-a951-74be456e7dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-44160830-eb47-468a-a951-74be456e7dba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:07.167751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:07.168660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:07.169474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:07.171332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:07.172512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:07.173356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:07.173356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:07.173356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:07.173356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:07.173356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 347/680] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:07.173639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.174375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 334/681] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:07.175472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160830-eb47-468a-a951-74be456e7dba None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.264855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.280399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ec6d-29e2-48b6-be8f-569c560ad974 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.284837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160830-eb47-468a-a951-74be456e7dba None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.316728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.317976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.318263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.318536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.319351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:07.319656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.321197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.324548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.325419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.325882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.326351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.327391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=29b8fa2fe2d046dcadd150265b166d56) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:07.327899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.329495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.333542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 348/682] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:07.334342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.341057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 335/683] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/role_assignments?user.id=29b8fa2fe2d046dcadd150265b166d56&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:07.342150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.387634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.451013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77059272-2bac-4eda-b561-f54fc573fb9e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.488069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134c2a-75b9-4476-9fc4-13c5cbd0b9a1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.490982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.492037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.492518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.492984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.493920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:07.494406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.496054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.509071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 349/684] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:07.511877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.527509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.548806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.549735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.550185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.550468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.551319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:07.551651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.553148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.571308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 336/685] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:07.571308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.646025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedd95-f0ea-491a-8381-630b625fdf48 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.668466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.684037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.691688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.691688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.691688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.691976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259ca7d-b378-4e87-bc09-501fd8594336 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.692079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=4091c55281ef4eeb8f2c4e9d84b2fe1f) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:07.692079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.692079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.695162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 350/686] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/role_assignments?user.id=4091c55281ef4eeb8f2c4e9d84b2fe1f&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:07.696041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.751176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.752485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.752864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.753146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.773092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.774305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:07.775845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:07.806261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:07.807463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:07.808540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:07.808540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:07.808540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:07.808540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:07.808764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e26387-b0b8-4920-94a5-4df52bcf368e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:07.816616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 337/687] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:07.824105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:07.850603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:07.851448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:07.851735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:07.852037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:07.861073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:07.862551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:07.878812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:07.880107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:07.881761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 351/688] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:07.887260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529d1a9-a6b5-4a85-99d1-8d1896d8c50b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.038930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2723d7f-a298-4eed-946a-ae7b21417b4e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.061963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.062665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.062949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.063248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.063979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:08.064283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.065655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.078405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.079171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.079689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:08.083573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 338/689] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:08.085907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.087590 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:08.091572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.091878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.092775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:08.097416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.097416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.115864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 352/690] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 08:53:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:08.122086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.200558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60509-adab-4f9b-a87c-b1c1c293b28f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.236226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c65922-35a6-496c-b08e-13a381e5ed8a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.237205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.238015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.238300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.238574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.247516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.248970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:08.264698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:08.265667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:08.266832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 339/691] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:08.274042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.277575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.277575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.277575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.277575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.336014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:08.339276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:08.352214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.353809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.382947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286a65-9fec-4695-8f0c-39b3eec71b62 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.418512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.419614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.420097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.420567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.421611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:08.422116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.423777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.447008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 340/692] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:08.448665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.462982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 353/693] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:53:08.468194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.620782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e128957-d255-48cc-b992-f24b529bed27 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.635657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:08.640369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:08.660681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5721f5-ef48-4658-a459-bde4947cfb8e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.666992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.669035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.669035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.674458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.725496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:08.726215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:08.726499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:08.726779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:08.748760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.750222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:08.771287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:08.772236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:08.773109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:08.773109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:08.773109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:08.773109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:08.773109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 354/694] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:08.777469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.798967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:08.800477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:08.930241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5419c-b7d7-4fff-934f-cec93c068d02 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:08.950846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 341/695] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 08:53:08.956229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:08.975973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.021758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.022706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.022990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.023282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.024170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.024755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.027785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d6d0f-4c28-45db-b571-92ab8ffb0b2d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.041600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.047428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 355/696] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:09.048764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03720f51-8fb6-4830-9cf2-1df5388d92bb None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.049055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03720f51-8fb6-4830-9cf2-1df5388d92bb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.049332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03720f51-8fb6-4830-9cf2-1df5388d92bb None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.050757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 356/697] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:09.056888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03720f51-8fb6-4830-9cf2-1df5388d92bb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.092560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b533c-55b5-4994-a964-1058624bbec4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.126956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.127787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.128064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.128333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.139415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.140888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-f3e3cb87-f6e8-498f-95a6-4b0f68a29076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:09.159497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:09.160454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:09.161409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:09.161409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:09.161409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:09.161409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:09.161409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 342/698] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:09.167257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.167257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.167257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.175135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03720f51-8fb6-4830-9cf2-1df5388d92bb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.182944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:09.184212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:09.210956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.211788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.212070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.212344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.219257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.220716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:09.235006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:09.237553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 357/699] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:09.239811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.252638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.254092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 343/700] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:09.260372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.317957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.358586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2b5a-a413-49fe-96b7-3facb587d100 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.372122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822322-f139-4f2f-9940-6f5c97afd69e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.396427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.397336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.397787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.398201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.399060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.399532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.401040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.407876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.408776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.408896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.409073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.409914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.410222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.411764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.418933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 358/701] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:09.420017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.424755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 344/702] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:09.425179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.487897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.529799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9711221-f0d6-4b74-913d-590faa0012b6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.545871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80630e-0d99-4844-8244-9faf0bcecf6a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.554484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.570698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.571833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.572274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.572688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.573483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.575049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.584956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.585800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.586086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.586407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:09.591012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:09.592218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:09.593270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:09.594075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.595063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.601105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 359/703] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:09.602125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:09.610957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:09.612081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 345/704] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:09.613250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.707214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b464df-d843-4ca8-99c0-de67d01db790 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.728956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c8983-1b1b-4d97-b0fe-6bd3db3c6205 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.742608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.743513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.743938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.744374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.745344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=35b1d5f68be34afc8a72843e869bc3b2) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.745799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.746627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.747572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.754339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 360/705] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/role_assignments?user.id=35b1d5f68be34afc8a72843e869bc3b2&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:09.755516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.767108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.767822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.768108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.768763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.769417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.769727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.771767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.781389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 346/706] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:09.783843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.818629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:09.873193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810592b-21cf-4ad2-ad74-e6d9afda5e92 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.898026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4040e6-9a3f-4022-a1f5-c0b578115620 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:09.912865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.914008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.914502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.914975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.916072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.916693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.918501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1e5c1-719e-4ada-a33b-00bc5c1973ac None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.940603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 361/707] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:09.942508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358a75-16c1-4d95-a43d-0cb9743bc48e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.943035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358a75-16c1-4d95-a43d-0cb9743bc48e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.943557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358a75-16c1-4d95-a43d-0cb9743bc48e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.945846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 362/708] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:09.947055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97358a75-16c1-4d95-a43d-0cb9743bc48e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:09.953257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:09.953958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.954240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.954512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:09.955263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:09.955566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:09.957040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec97447-cb6a-41d5-90c4-e3928983e5d8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:09.971272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 347/709] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:09.971272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:09.971272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:09.971272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.003864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:10.006779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:10.094636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:10.139259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 348/710] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:10.149837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97358a75-16c1-4d95-a43d-0cb9743bc48e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:10.161558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:10.163562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:10.200463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:10.201500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:10.202139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:10.203482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.208853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=7d7ba842465543478b83e1bf3c018223) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:10.208853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:10.208853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:10.215203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 363/711] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:09 2022] GET /identity/v3/role_assignments?user.id=7d7ba842465543478b83e1bf3c018223&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:10.281668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e89c06-c3e0-4531-b2af-cb712f9859da None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:10.326269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:10.327156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:10.327482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:10.327760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.328490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:10.329987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:10.348359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:10.349964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:10.350775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 349/712] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:10 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:10.357522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:10.473370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7550-3b45-4cbc-bae7-352a32104540 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:10.511510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:10.512190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:10.512478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:10.512758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.513469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] RBAC: Adding query filter params (name=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:10.513778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:10.515200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22511ff2-de39-493e-8649-59d6a0e83462 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:10.519921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 364/713] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:10.526090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:10.570886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:10.636906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9a73-42b1-4555-8809-22d8353239f4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:10.678471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:10.679159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:10.679471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:10.679751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.680472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] RBAC: Adding query filter params (type=network) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:10.680786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:10.682193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499513a5-b4eb-4cf8-b46b-47b407ea4d62 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:10.687728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 350/714] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:10.742968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054858-eec0-4ffb-bf58-bc9a177a7e9f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:10.743313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054858-eec0-4ffb-bf58-bc9a177a7e9f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:10.743559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e054858-eec0-4ffb-bf58-bc9a177a7e9f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.745326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 365/715] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:10.750541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:10.750836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:10.751117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:10.776347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:10.777572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:10.873063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 351/716] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:10.917325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054858-eec0-4ffb-bf58-bc9a177a7e9f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:10.972274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:11.074452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e054858-eec0-4ffb-bf58-bc9a177a7e9f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:11.122370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:11.123618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:11.124103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:11.124573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:11.140369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:11.142098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:11.164509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:11.165438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:11.166317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:11.166317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:11.166317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:11.166317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:11.168661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 366/717] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:11.174023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:11.211128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:11.304713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1830b3-c8cb-41c1-966c-e9cbbf55b06f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:11.354968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:11.355759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:11.356044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:11.356329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:11.357067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:11.357373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:11.358772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe497752-5402-4775-b6dd-dc4676d53cd1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:11.374502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 352/718] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:11.380301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:11.510956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:11.526938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e09e9d-3777-4502-a845-288e238dbac5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:11.572471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763dc6c-0031-44a2-972b-282a82d480a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:11.573184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763dc6c-0031-44a2-972b-282a82d480a8 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:11.573557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763dc6c-0031-44a2-972b-282a82d480a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:11.573831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763dc6c-0031-44a2-972b-282a82d480a8 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:11.574589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763dc6c-0031-44a2-972b-282a82d480a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:11.576057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763dc6c-0031-44a2-972b-282a82d480a8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:11.662046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 367/719] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:53:11 2022] POST /identity/v3/users => generated 254 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:12.583562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b70e-a98a-4171-a5c1-e15a9feb7bd2 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.584619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b70e-a98a-4171-a5c1-e15a9feb7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.585114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b70e-a98a-4171-a5c1-e15a9feb7bd2 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.586959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 353/720] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:12.592613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b546e77-b289-4f66-8628-1edf8b4456bb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.593472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b546e77-b289-4f66-8628-1edf8b4456bb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.593955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b546e77-b289-4f66-8628-1edf8b4456bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.612164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7b546e77-b289-4f66-8628-1edf8b4456bb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:12.613700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7b546e77-b289-4f66-8628-1edf8b4456bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:12.705038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 368/721] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:12.740255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b70e-a98a-4171-a5c1-e15a9feb7bd2 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:12.849906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48165b-32ab-46a5-86e4-bfd0e6c574d8 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.850519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48165b-32ab-46a5-86e4-bfd0e6c574d8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.851003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48165b-32ab-46a5-86e4-bfd0e6c574d8 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.852875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 369/722] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:12.857985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5b36-b81a-40fe-8c76-3837a93e61f3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.858503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5b36-b81a-40fe-8c76-3837a93e61f3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.858985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5b36-b81a-40fe-8c76-3837a93e61f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.876980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-407f5b36-b81a-40fe-8c76-3837a93e61f3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:12.878518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-407f5b36-b81a-40fe-8c76-3837a93e61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:12.891614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:12.902991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b70e-a98a-4171-a5c1-e15a9feb7bd2 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:12.954124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:12.954808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.955093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.956217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.956854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:12.958381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:12.967365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 370/723] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 08:53:12.969009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c86d4-f125-45e0-bd11-4c5a0992a2b7 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.969520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c86d4-f125-45e0-bd11-4c5a0992a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.970002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c86d4-f125-45e0-bd11-4c5a0992a2b7 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.971777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 371/724] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:12.977316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:12.978626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:12.978626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:12.985148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:12.999001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:13.000230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:13.030947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 354/725] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:12 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:13.034246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.112166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 372/726] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:13.147428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.175542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec857-f008-4a30-acb9-59b860fdaad2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.220143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.221477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.221949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.222660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.236957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:13.247872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:13.249023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:13.250053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:13.253480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 355/727] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:13.259920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.277456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:13.310272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc076d4-05b0-4bf2-b0ae-78877c5e8c3f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.341297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:13.347563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.349166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.349562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.349944 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.362149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:13.370350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:13.371607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:13.372682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:13.374914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 373/728] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:13.380125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b023d6-ea87-495c-9a10-97d889af71f7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.381319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.420226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.421153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.421603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.422025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.422932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:13.423437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:13.424965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:13.434313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 356/729] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:13.440034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.491708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca74ab-0115-4cb9-82b5-84d5f4050da1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.525510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:13.540680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.541493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.541905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.542289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.543152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:13.543595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:13.545095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:13.560101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 374/730] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:13.567862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.585339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dd131-72fe-478f-aca3-4aaa35ba3617 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.635972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.636925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.637276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.637616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.648586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:13.650139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:13.667963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:13.669087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:13.670201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:13.670201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:13.670201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:13.670201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:13.674866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 357/731] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:13.675485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:13.676013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.763256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141410f-9e86-4f08-924f-8b1bc51d0e5e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.809608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.810406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.810689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.810965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.821687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:13.822501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6b10c-7b46-4167-9448-fb86a5da22f2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.823143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8595091b-0a6e-4696-b100-497a887a7f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:13.843185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:13.844133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:13.845007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:13.845007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:13.845007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:13.845007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:13.845007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 375/732] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:13.846600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ed076-aae7-439e-83ae-07e193027539 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.846600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ed076-aae7-439e-83ae-07e193027539 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.846600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ed076-aae7-439e-83ae-07e193027539 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.849612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 376/733] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:13.850682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ed076-aae7-439e-83ae-07e193027539 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:13.858325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:13.867706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:13.868376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.868661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.869087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.869821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:13.872559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:13.872559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb615f86-9f3a-4165-8ed3-29391fa09334 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:13.890157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 358/734] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:13.891515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:13.892074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:13.892353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:13.910553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:13.912639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:13.966691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ed076-aae7-439e-83ae-07e193027539 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:13.969890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.008969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.009651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.009945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.010210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.011017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:14.011491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.017793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.017915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 359/735] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 08:53:14.017915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.037433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 377/736] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:14.038095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.150460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcff5e-6a44-4dae-ad5b-3a21382c6600 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.154703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e892176-5f88-4602-a49f-d97d60571da4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.170933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.191950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.192652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.193280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.193463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.193741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.194022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.194352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.194823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.195781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.198405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.203029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.204683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:14.222320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:14.224604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:14.226116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:14.228744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 360/737] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:14.229574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.276141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 378/738] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:14 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:14.277503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.338700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.400749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee7b02-fa43-46b6-b3af-bca628219f08 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.468941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.469770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.470053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.470327 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.487285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.488843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:14.516902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:14.517927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:14.523851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 361/739] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:14.525986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36928a-f338-45c2-9b48-0aeeb5c68eb0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.535340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.576451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.581996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.582719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.583002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.583305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.584167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:14.584480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.585937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.607047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 379/740] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:14.612929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.660991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1b70c-4ad4-4603-9a40-b9b65e30940a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.696957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.697960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.698419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.698868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.699910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:14.700422 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.702179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.718686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.727248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301b641-ac4a-4d2f-96a9-f538473d30ee None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.727765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 362/741] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:14.729331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.762607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.763905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.764266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.764656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.775731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.777504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:14.796455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:14.797371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:14.798390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:14.798390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:14.798390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:14.798390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:14.798390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 380/742] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:14.804597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:14.831973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.844303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59422-fc0b-4a15-8752-41a3caf9201a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.879317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeeaa1d-553d-480b-8112-ee224d7048e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.880860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeaa1d-553d-480b-8112-ee224d7048e6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.881287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeaa1d-553d-480b-8112-ee224d7048e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.881703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeaa1d-553d-480b-8112-ee224d7048e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.933884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1761c9-02c8-4f7c-a8af-f3f11a3de2ee None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:14.959963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeeaa1d-553d-480b-8112-ee224d7048e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.961775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeeaa1d-553d-480b-8112-ee224d7048e6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.977187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:14.978236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:14.978537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:14.978823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:14.979897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:14.980226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:14.981774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:14.995187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:14.995464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 381/743] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:15.004247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.130803 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.147201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 363/744] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 08:53:15.148591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009b3a4-306e-4058-8289-3d7d2abb776f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.148885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009b3a4-306e-4058-8289-3d7d2abb776f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.149168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009b3a4-306e-4058-8289-3d7d2abb776f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.150709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 364/745] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:15.153073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009b3a4-306e-4058-8289-3d7d2abb776f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.181676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc7ec9-9210-4c6d-81de-30580fde375a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.218172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.218976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.219296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.219585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.226925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.228431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d6aff5d3-9436-45a3-9afd-859ffdfae915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:15.244466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:15.245379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:15.246251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 382/746] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:15.248187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.248187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.248187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.265460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:15.266046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009b3a4-306e-4058-8289-3d7d2abb776f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.266668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:15.302748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.303618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.303900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.304176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.315761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.317778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.319419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:15.336949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:15.344207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:15.345114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:15.345114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:15.345114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:15.345114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:15.345114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 365/747] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:15.345114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.345791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 383/748] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:15.346841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.388517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.456557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5242c5-af62-4c54-9351-1201a1dd1f56 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.479194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b38e-c5cf-43cb-94e5-b616ac829178 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.496530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.497444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.497872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.498309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.499228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:15.499789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.501374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.514202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.514875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.515164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.515475 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.516201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:15.516510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.517448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 366/749] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:15.517905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.518709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.530577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 384/750] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:15.536246 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.584895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.632962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499df1-6671-4db4-a65c-6353dff67c69 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.634973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.640256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd108-16b0-4739-b40a-ea33ed926c1f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.673695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.674502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.674788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.675065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.684864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.686286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.686410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:15.686914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.687452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/7d7ba842465543478b83e1bf3c018223/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.689712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=7d7ba842465543478b83e1bf3c018223, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.691403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:15.694962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:15.695936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 367/751] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:15.697798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.766739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 385/752] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:15 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/7d7ba842465543478b83e1bf3c018223/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:15.768997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.837199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff294d-be38-4fc2-b284-4257ce8b79b0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.882550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.883767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.884428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.885357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.895562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.897871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.904251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23a6b5-8ce4-4e78-beda-e9249d5bec52 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:15.907621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-1d5fc3d0-857c-4246-8bca-9624d868fbda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:15.919147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:15.920309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:15.921198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:15.925305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 368/753] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:15.925479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3d578-9f29-4a2d-b5f5-137ac13cf99e None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.925793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3d578-9f29-4a2d-b5f5-137ac13cf99e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.926150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3d578-9f29-4a2d-b5f5-137ac13cf99e None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.931394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 369/754] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:15.934885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3d578-9f29-4a2d-b5f5-137ac13cf99e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:15.968326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:15.970571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.970571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.975061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:15.975161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:15.975161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:15.975161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:15.975161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d034-ec5b-419b-b7d1-d4b8ca82ccf8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:15.983496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 386/755] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:15.984597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:15.984959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:15.985161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.005259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:16.006446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:16.063053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3d578-9f29-4a2d-b5f5-137ac13cf99e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.080109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 387/756] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:16.081180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.124880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.125863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.126157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.126978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.128246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:16.128835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.130311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.147728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 370/757] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:16.152217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.201268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:16.207137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80418-53cc-4cfe-a867-15ce3cd5119a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.244375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.245281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.245639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.245987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.259350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.260929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.265781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:16.279369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:16.280557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:16.281701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:16.281701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:16.281701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:16.281701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:16.282726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 388/758] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:16.283640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.292223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7d3bd-e249-4eea-bf3e-317ba3b2db47 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.343910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.345314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.345788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.346498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.347806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.350218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:16.367503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:16.368495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:16.369341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:16.377380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 371/759] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:16.377380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.402190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8ec9-24e0-4d1d-8089-4d6d2618b83c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.438716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.439457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.439754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.440161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.441082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=35b1d5f68be34afc8a72843e869bc3b2) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:16.441403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.442920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.455293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 389/760] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/role_assignments?user.id=35b1d5f68be34afc8a72843e869bc3b2&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:16.455293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.466450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:16.544239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b892d-3403-4b92-841c-e2311d8caaa4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.570993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398416a-b7d8-428b-b84c-c7867cf86bbc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.628597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.629288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.632258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.632542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.633298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:16.633611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.639700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.654015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.654710 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.654997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.655299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.656033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:16.656342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.657751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.668038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 390/761] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:16.669919 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 372/762] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:16.678328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.678945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.699618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:16.782165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:16.800877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9e73-bc54-4c77-a8b9-1392e1f9bf4e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.826315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38d7ff-fa7f-417e-b004-f6c5bb4bc08d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:16.838967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.839818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.840105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.840384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.841103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:16.841409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.842790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.854633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 391/763] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:16.855271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:16.884497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:16.885247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.885581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.885856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.902401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:16.903914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-d2a01261-a9e9-4294-b57c-0105238dc155 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:16.937818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:16.938782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:16.939745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 373/764] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:16.940817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe59c-4724-4c39-9ed4-e5773e1b55de None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:16.943285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe59c-4724-4c39-9ed4-e5773e1b55de None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:16.943285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe59c-4724-4c39-9ed4-e5773e1b55de None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:16.943285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 374/765] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:16.944659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe59c-4724-4c39-9ed4-e5773e1b55de None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.002445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890af932-a36f-4832-857b-da3277f3c8b2 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.032929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.043290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.043290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.043290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.043290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.055852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] RBAC: Adding query filter params (interface=public, service_id=61c8c189e8c343c48d314d4297d1146d, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:17.055852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.055852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43548936-66ed-4bdf-aae9-6b0fb875d533 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.055852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 392/766] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/endpoints?service_id=61c8c189e8c343c48d314d4297d1146d&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:17.056309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.056609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.056894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.063070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.075214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:17.076520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:17.078155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe59c-4724-4c39-9ed4-e5773e1b55de None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.119988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.120668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.120949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.121224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.122060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:17.122366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.123847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.149753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 375/767] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 08:53:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:17.150958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.164381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 393/768] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:17.165243 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.283136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d9fd-5204-45e4-ac8f-e1760d187f4f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.283920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de92f2-3b7d-4fd4-a495-bb1886ee8e08 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.309782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.319718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.320376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.320657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.320933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.323010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.323641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.325001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.325491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.325967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.326852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.328484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.334793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 376/769] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:17.335964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.407006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.408862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.524398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a025f-3fe7-4408-bfc6-0c951c5f0e64 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.563732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 394/770] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:17.570479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.588784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.590066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.590356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.590638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] PATH_INFO: `/v3/services/network` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.591338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.593482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:17.610948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:17.612000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:17.612832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:17.613566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 377/771] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:17.619960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.623622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.695766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.705057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0c1f-5466-4e62-b7c8-0fd9c0c256b5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.758079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.759384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.759676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.759957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.771152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.773240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:17.793408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:17.794953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:17.795976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:17.795976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:17.795976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:17.795976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:17.795976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 395/772] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:17.797361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2bc30-7fa4-4e9d-9d73-a1d6a78527ed None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:17.800431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.880077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:17.880917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:17.881302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:17.881708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:17.882523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] RBAC: Adding query filter params (name=network) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:17.882934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:17.884467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:17.889802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 378/773] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:17.896127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:17.965104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:17.993701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9a44-ed85-4972-86b5-c606cb9cc0cc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.050870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2cb2-737d-4242-9b53-5335452a38ca None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.072220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:18.080342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.081309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.081762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.082205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.085078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:18.085731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.088104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.110637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.111678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.112178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.112651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.113553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] RBAC: Adding query filter params (type=network) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:18.113772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 396/774] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:18.114866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:18.115404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.117015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.132410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 379/775] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:18.138003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:18.256342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9514-16b9-4490-9d9c-e2ca442849ac None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.306719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73791d09-fba2-49b1-8c4a-77d2bee5cdbc None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.325399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.326347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.326816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.327302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.328299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] RBAC: Adding query filter params (interface=public, service_id=fa8d0107258c40509476e7e4d39ea132, region_id=RegionOne) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:18.328795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.330364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.346894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 380/776] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:18 2022] GET /identity/v3/endpoints?service_id=fa8d0107258c40509476e7e4d39ea132&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:18.352546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:18.362773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.364306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.364660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.365001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.372124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.373709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-64ef9839-c13e-4b0f-953f-4c1022fe5898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:18.389557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:18.390506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:18.391431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:18.395520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 397/777] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:18.396856 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139097dd-af02-442b-846b-510e43e06065 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.397144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139097dd-af02-442b-846b-510e43e06065 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.397422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139097dd-af02-442b-846b-510e43e06065 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.400941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 398/778] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:18.401681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139097dd-af02-442b-846b-510e43e06065 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:18.409063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:18.413942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:18.480064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b6ed9-1e25-455d-b7ce-1913d98a1f9d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.510340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139097dd-af02-442b-846b-510e43e06065 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.529682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.530367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.530646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.530920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.531623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.534236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.548209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.548874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.549158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.549434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.550224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:18.550531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.552020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2216-469d-426c-ba30-d8a4388b2261 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.564223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 399/779] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:18.565470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.565758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.566040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.571770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 381/780] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:18 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:18.572701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:18.607730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:18.609127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:18.693582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b5568-2f16-43b6-be67-78a1c6747557 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:18.707710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:18.736122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:18.737249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:18.737707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:18.739229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:18.748682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=13e35a595b9646a28a26177eae068397) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:18.748682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:18.748682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:18.755334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 382/781] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:18 2022] GET /identity/v3/role_assignments?user.id=13e35a595b9646a28a26177eae068397&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:18.790471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:18.806321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 400/782] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:18.849523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:18.979483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fcfd7-ace4-486c-ae67-9b8826f74ee8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.021198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c328d-2af6-49d2-b12e-4eb687675b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:19.022065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c328d-2af6-49d2-b12e-4eb687675b05 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.022348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c328d-2af6-49d2-b12e-4eb687675b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.022685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c328d-2af6-49d2-b12e-4eb687675b05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.033646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c328d-2af6-49d2-b12e-4eb687675b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-257c328d-2af6-49d2-b12e-4eb687675b05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:19.041622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:19.042510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:19.043622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 383/783] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:19.050569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.155285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fbece-7607-4225-9b5d-295395625f52 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.155961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fbece-7607-4225-9b5d-295395625f52 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.156444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fbece-7607-4225-9b5d-295395625f52 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.158282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 384/784] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:19.161291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941eaf9-2364-4eba-8bbe-03b564d17d15 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.163600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.164118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.164592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.182620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:19.184174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:19.204997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:19.205859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.206147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.206429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.207188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:19.207560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:19.208943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:19.225044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 401/785] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:19.231707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.245359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:19.328930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 385/786] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:19.339439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:19.364922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.410509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f461-d9f8-400a-981d-93d392587265 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.471927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:19.472737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.473582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.473873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.497914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:19.499442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:19.532560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:19.533521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:19.534424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:19.534424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:19.534424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:19.534424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:19.543456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca75d-d342-4bbb-8cf6-a07f913e1e9d None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.545197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 402/787] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:19.546102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.629079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:19.630327 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.630810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.631303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.666691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b79f7-d72c-459c-bf11-4f8207c0d217 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.667949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:19.676765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:19.677730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:19.678557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:19.681355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 386/788] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:19.687187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.694257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:19.707323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:19.707323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.707323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.707323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.707712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:19.707712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:19.707712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:19.722708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 403/789] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:19.732561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.737776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:19.824598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dacbdd-875e-4e62-9cd3-46c9d586e2f7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.860605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:19.861596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:19.862083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:19.862560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:19.863642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:19.864686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:19.866290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:19.880078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 387/790] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:19.882226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:19.963501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdca7f-051c-4ec1-8378-d1a84ecfcf12 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:19.978962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:19.996241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398786-18e1-4261-86d7-6a97e4668a08 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.032732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.033601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.033889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.034588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.037392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.038198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.038480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.038753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.046448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.047970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.050420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.051938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:20.066085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:20.067028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:20.068063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:20.068063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:20.068063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:20.068063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:20.069158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 388/791] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:20.074008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:20.075127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:20.076321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 404/792] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:53:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:20.077039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.084215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.143618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:20.192318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97823-b85d-4c70-9cfe-7ba99e350541 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.228963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.229642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.229929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.230208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.230941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:20.231265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.232801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335a514-864a-4225-bf02-4583367b8183 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.235635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:20.247348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 389/793] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:20.248999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660ab6-4af1-4b2e-90b8-fc55fea6734f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.252310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660ab6-4af1-4b2e-90b8-fc55fea6734f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.252310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660ab6-4af1-4b2e-90b8-fc55fea6734f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.252310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 390/794] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:20.259920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660ab6-4af1-4b2e-90b8-fc55fea6734f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.265078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea241c-872e-4ec5-87c7-03071495a679 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.306943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.307672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.307956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.308231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.309790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:20.309790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.310794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363c54e-c26d-4f64-bb14-cbd1c8160dc7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.329659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 405/795] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:20.331022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.331370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.331652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.349363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:20.350553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:20.400446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660ab6-4af1-4b2e-90b8-fc55fea6734f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.427265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 406/796] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:20.427265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.453153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:20.459830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.461321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.461882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.463042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.472572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.474831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:20.496585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:20.504202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:20.505143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:20.507085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 391/797] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:20.508596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.558514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a1904-bf74-4f7e-8d05-0c7de0476135 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.574950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:20.607317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.608338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.609408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.609907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.622409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c70f3-af7b-4805-abae-f046e82f1ee4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.659177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.659948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.660236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.661120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.661775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.663163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:20.676246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:20.677206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 08:53:20.678057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:20.682468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 392/798] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:20.683355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.708273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.709783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.731404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:20.800558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec5252-e033-4867-95ef-4c233dcc71d5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.823451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:20.846595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 407/799] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:20.847632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.847744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:20.849230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:20.849716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:20.850189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:20.852659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:20.853210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:20.855889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:20.886984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 393/800] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:20.889253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:20.962411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acf63e-b67e-4001-9c12-3ace2902f54d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:20.983217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.005175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.006683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.006683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.006683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.007140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:21.007516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.008961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.020286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 408/801] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:21.021840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.036191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617798-789b-40bf-bfa8-a151acf02fbc None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.085908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.087062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.087606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.088174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.103336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.105394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:21.129498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:21.130467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:21.131926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:21.131926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:21.131926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:21.131926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:21.131926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 394/802] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:21.131926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.153704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88d69-fd14-4e1a-9b68-437150509553 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.164894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.202739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.204089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.205112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.205575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.220277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.221735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.244798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc43b0f-a979-455a-8553-98531d846a60 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:21.248084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:21.248946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:21.249809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:21.249809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:21.249809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:21.249809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:21.257257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 409/803] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:21.257257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.294415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.297455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.298387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.298896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.299422 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.300348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:21.300873 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.302934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.310777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 395/804] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:21.311873 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.371137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d7de-2131-4fa8-a574-077c3b6b6138 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.406921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.407633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.407914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.408191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.409019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:21.409213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.410613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.412312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.418612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268491fd-b6e8-4ff9-9f01-54c2c4479681 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.421911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 410/805] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:21.422684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.455039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.455657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.455949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.456237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.456960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:21.457321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.458708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fde18-ef69-4713-bb28-e92e85de96b9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.469828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 396/806] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:21.471041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273bac4-e1e0-424f-866d-64c872a0cd4e None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.471365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273bac4-e1e0-424f-866d-64c872a0cd4e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.471645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273bac4-e1e0-424f-866d-64c872a0cd4e None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.473023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 397/807] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:21.474096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7174ea-6515-4cdd-8048-bea823ad8c92 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.474386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7174ea-6515-4cdd-8048-bea823ad8c92 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.474665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7174ea-6515-4cdd-8048-bea823ad8c92 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.476035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 398/808] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:21.476809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7174ea-6515-4cdd-8048-bea823ad8c92 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.525037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.531946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61eafd-4223-4b85-a091-aad6ca73364f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.565243 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.565903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.566186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.566469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.567872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.569260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.579086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7174ea-6515-4cdd-8048-bea823ad8c92 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.612361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.613271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.614084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.614366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.621106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.622552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.640626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 411/809] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:21.640626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-8f0fcd67-4000-4e4b-92b0-1f4e7cee7226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:21.640950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:21.641966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 399/810] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08ec2-f3fb-4c2c-83ab-c32b349eb98a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.643070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08ec2-f3fb-4c2c-83ab-c32b349eb98a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.643918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08ec2-f3fb-4c2c-83ab-c32b349eb98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.660683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fad08ec2-f3fb-4c2c-83ab-c32b349eb98a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:21.661992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fad08ec2-f3fb-4c2c-83ab-c32b349eb98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:21.672843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.759339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 400/811] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:21.759339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.759339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.759339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.770401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e731-1016-46fd-acdf-0170bf432050 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.779641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:21.781322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:21.808114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:21.808928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:21.809210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:21.809484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:21.817209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:21.818683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:21.833904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:21.834814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 412/812] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:21.836408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.852365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.865179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 401/813] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:21.866031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:21.941450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:21.967960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c1ec-1dc9-48cb-afb6-85e92dcd610b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:21.974942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f151b5-f06f-4adc-93f4-5c761f9e3089 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.004002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.004701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.004991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.005273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.006064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:22.006379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.007867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.013510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.014697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.014984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.015283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.024217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 413/814] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:22.024217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.031306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:22.040341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:22.041288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:22.042130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 402/815] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:22.043645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.098772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:22.129540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d2f9-4b36-46b8-85c0-b0166c3db017 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.150048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b36c2-234b-4565-bbf6-d67f6a9a4255 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.166865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.167568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.167853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.168150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.168941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:22.169251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.170683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.178685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:22.184417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.190128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 414/816] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:22.190266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.190266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.190266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] PATH_INFO: `/v3/services/network` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.190907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.190982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.190982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:22.203057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:22.204316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 08:53:22.205290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:22.206024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 403/817] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:22.206526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.306588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e2f5-2fd5-4f9e-bb22-83fe52722c20 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.317707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801bd8-c26d-4dbb-bb4f-ff76e4511602 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.336379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:22.342959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.349147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.349147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.349147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.349147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=7d7ba842465543478b83e1bf3c018223) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:22.349147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.349147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.353755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.359413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.359584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 415/818] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/role_assignments?user.id=7d7ba842465543478b83e1bf3c018223&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:22.359704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.359704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.359872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.359959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:22.359959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.359959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.374979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 404/819] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:22.376097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.451679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:22.497875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fed54-d936-4f13-bf75-049ff807d8ea None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.523281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e0fae-856d-4875-81b1-cf2ee3dc6fa2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.538400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.539896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.540186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.540524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/35b1d5f68be34afc8a72843e869bc3b2/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.545261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=35b1d5f68be34afc8a72843e869bc3b2, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.545261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.568208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.568996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.569287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.569619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.570377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:22.571526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.572965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.578693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 405/820] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:22.579582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.627752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 416/821] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:22 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/35b1d5f68be34afc8a72843e869bc3b2/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:22.628505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.702513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:22.710819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1adec-0755-4927-9aef-57fcff47a7d9 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.738141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:22.754741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.756048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.756347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.756631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.770670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.772368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:22.794619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:22.795616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:22.796525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:22.796525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:22.796525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:22.796525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:22.796745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 406/822] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:22.803313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.836980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f2fa5-9d5b-4e69-8abc-eefb35db9413 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:22.900499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:22.900499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:22.900499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:22.900499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:22.900925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] RBAC: Adding query filter params (type=network) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:22.900925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:22.900925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:22.905081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 417/823] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:22.910412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:22.964998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db48ed-4e49-4f4b-b903-30c638116788 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:23.007078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:23.008279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:23.008849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:23.009331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:23.010272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:23.010785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:23.012879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:23.021799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef26845-bbd7-4f46-95ff-88d5f91cb751 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:23.027763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 407/824] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:23.037231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:23.048484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:23.076006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:23.076717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:23.077001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:23.077281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:23.078077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:23.080262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:23.094911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:23.166549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccfc6e-ce21-428d-9a7e-f93165a3b472 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:23.193111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 418/825] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:23.228727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:23.229581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:23.229927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:23.230212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:23.241690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:23.243344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:23.264052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:23.265100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:23.266068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 408/826] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:53:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:23.273225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:23.404708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cd6c7-5ed2-403d-ae45-897403d8ce39 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:23.453610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:23.454660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:23.455174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:23.455696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:23.456740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:23.457320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:23.458948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:23.477923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 419/827] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 08:53:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:23.483688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:23.580690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:23.594675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da10fa-9a44-4857-a8a5-82cf4676d3f6 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:23.635738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:23.636907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:23.637373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:23.637831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:23.651682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:23.653394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:23.673097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:23.673998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:23.674883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:23.674883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:23.674883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:23.674883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:23.676883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 409/828] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:23.682466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:23.720102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:23.814815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f0f0-ebcf-425d-ad43-c41cc38c3d33 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:23.850043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:23.850709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:23.850988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:23.851280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:23.852005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:23.852307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:23.853672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:23.866186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 420/829] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:23.872249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:23.986535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8b397-1221-47d2-b685-b8f3031ed37f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:24.023097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:24.023938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.024222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.024497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.031730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:24.033194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:24.036365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-f09b38c3-369b-416e-8d93-2d9a70a4e939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:24.048164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:24.050994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:24.052017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 410/830] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:24.055048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:24.111499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eeb6e-adf2-4967-afdc-c06c4978fd67 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.111831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eeb6e-adf2-4967-afdc-c06c4978fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.112068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eeb6e-adf2-4967-afdc-c06c4978fd67 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.114304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 411/831] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:24.119584 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.119881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.120165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.142903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:24.144172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:24.170107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:24.181521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406cda1-fc6e-437e-8213-29160dc7495e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:24.215957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:24.216628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.216914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.217198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.217988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:24.218299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:24.219786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:24.229273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 412/832] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:24.240901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 421/833] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:24.248299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:24.255416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:24.356681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d62e5-bbce-45c5-a73f-0039bf163cee None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:24.389024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:24.395448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:24.396090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acd0d5-c518-423c-80a6-24096dfd43f6 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:24.396355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.396640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.397079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/13e35a595b9646a28a26177eae068397/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.412400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=13e35a595b9646a28a26177eae068397, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:24.421730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:24.435540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:24.436293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.436575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.436866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.437501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:24.438869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:24.451295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:24.452268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:24.453095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 422/834] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:24.458346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:24.476702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:24.527545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 413/835] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:24 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/13e35a595b9646a28a26177eae068397/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:24.570472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518424-fb5c-4d82-8dd6-555929a883a4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:24.610042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:24.611123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.611665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.612144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.613101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:24.614122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:24.615788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ff03-614b-445b-808d-d40add7b8f8d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:24.621796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 423/836] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:24.628781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:24.746808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1e24-ebb8-41b4-9b64-03ec034e6d40 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:24.784855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:24.786059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:24.786346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:24.786622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:24.787360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:24.787670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:24.789056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be9ba-e79b-4c11-bfeb-0e29b84501b9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:24.797506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 414/837] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:25.037084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51805a3-8655-45e0-b476-c5f8ee332de0 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.037275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51805a3-8655-45e0-b476-c5f8ee332de0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.037560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51805a3-8655-45e0-b476-c5f8ee332de0 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.039221 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 424/838] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:25.044640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ebb5d-eac0-4ffd-b1ab-9a8760dc96d7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.045096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ebb5d-eac0-4ffd-b1ab-9a8760dc96d7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.045193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ebb5d-eac0-4ffd-b1ab-9a8760dc96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.064020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-698ebb5d-eac0-4ffd-b1ab-9a8760dc96d7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:25.065193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-698ebb5d-eac0-4ffd-b1ab-9a8760dc96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:25.105842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:25.137462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 415/839] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:25.161177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51805a3-8655-45e0-b476-c5f8ee332de0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:25.252644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:25.271522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51805a3-8655-45e0-b476-c5f8ee332de0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:25.291465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486f04-3529-48ec-a8e1-afae81e7f431 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.291742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486f04-3529-48ec-a8e1-afae81e7f431 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.291958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486f04-3529-48ec-a8e1-afae81e7f431 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.294287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 416/840] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:25.300363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.300655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.301464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.307689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:25.308679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.308968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.309240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.309899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:25.311293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:25.320135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:25.321330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:25.324421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:25.325355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:25.326170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 425/841] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 2 08:53:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:25.334081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:25.405883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 417/842] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:25.430236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:25.452781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36419b-e49d-4983-bbc7-adc1e75d2787 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:25.498156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:25.498831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.499121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.499537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.500255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:25.500567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:25.502199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:25.507271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 426/843] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:25.512574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:25.525132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:25.561034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422255-b837-47cd-a3e2-f9e84486b743 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:25.563918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:25.617770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:25.618835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.619179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.619781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.629446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a98257-8ce0-4b96-9aab-e768875f126d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:25.633793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:25.643075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:25.644055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:25.645459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:25.647401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 418/844] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:25.651560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:25.677294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:25.678110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.678398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.678675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.679413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:25.679896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:25.681837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:25.691442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 427/845] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:25.773196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1828d-42ac-41fb-b7cc-37664820cae5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:25.815967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:25.816655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.816938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.817213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.817969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:25.818274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:25.819705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:25.829734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 419/846] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:25.835394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:25.915879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:25.946736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef803682-b767-4875-980c-08633746b1d9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:25.982513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:25.983341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:25.983623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:25.983899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:25.996979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:25.998479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:26.016792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:26.017737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:26.018621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:26.018621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:26.018621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:26.018621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:26.018621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 428/847] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:26.024447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:26.053573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:26.129145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d65be-fca9-4534-bc03-47060cc81ce9 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:26.164604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:26.165277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:26.165559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:26.165833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:26.166544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:26.166846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:26.168246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:26.181196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 420/848] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:26.186534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:26.290149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdb80f-4e9d-4bcc-8372-055421228696 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:26.314120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:26.324940 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:26.325740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:26.326023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:26.326298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:26.334690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:26.336179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:26.351199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:26.352401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 08:53:26.353582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:26.356250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 429/849] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:26.361891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:26.455794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:26.465295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42764fe1-0c7a-422b-bd7e-e769c8b27e1c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:26.502750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:26.503462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:26.503744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:26.504046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:26.504877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:26.505182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:26.506624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:26.525692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 421/850] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 2 08:53:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:26.531723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:26.639781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cad7d-f66e-435b-a83b-e79b4c381353 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:26.674804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751de3-b6fd-410c-b61f-a9a34c064271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:26.675487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751de3-b6fd-410c-b61f-a9a34c064271 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:26.675797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751de3-b6fd-410c-b61f-a9a34c064271 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:26.676074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751de3-b6fd-410c-b61f-a9a34c064271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:26.737634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:26.747914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0751de3-b6fd-410c-b61f-a9a34c064271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:26.749506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0751de3-b6fd-410c-b61f-a9a34c064271 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:26.856548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 430/851] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:26.862021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:26.875205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462980e1-f11f-467d-95e5-9d433fcfa223 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:26.875531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462980e1-f11f-467d-95e5-9d433fcfa223 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:26.875814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462980e1-f11f-467d-95e5-9d433fcfa223 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:26.877701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 431/852] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:26.882715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:26.883006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:26.883322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:26.900256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:26.901454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:26.989015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 432/853] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:26.989469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76247f0c-0c97-4bda-ab7b-1f501e34cd92 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.012842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.029084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.029785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.030816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.031098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.031401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.045463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.047558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.051459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:27.071148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:27.072730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:27.074105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:27.074105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:27.074105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:27.074105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:27.074105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 422/854] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:27.079223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.128417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b2cd-4783-45d9-bf5e-4e979f935550 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.170076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ec5c8-e48d-4e03-a216-4f0b17160f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.170883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec5c8-e48d-4e03-a216-4f0b17160f59 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.171168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec5c8-e48d-4e03-a216-4f0b17160f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.171478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ec5c8-e48d-4e03-a216-4f0b17160f59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.184914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ec5c8-e48d-4e03-a216-4f0b17160f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:27.188104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a6e8-1e1d-4b1e-9ea1-c024e67672d1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ac7ec5c8-e48d-4e03-a216-4f0b17160f59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:27.193507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:27.194804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:27.195683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 433/855] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:27.196387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8fc0f-8706-4294-973f-f7d52d906b01 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.196920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8fc0f-8706-4294-973f-f7d52d906b01 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.196920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8fc0f-8706-4294-973f-f7d52d906b01 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.198115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 434/856] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:27.202633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8fc0f-8706-4294-973f-f7d52d906b01 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.232743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.233409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.233690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.233964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.234683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:27.234984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.236379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda373d0-569b-4810-a368-22d7953392aa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.247979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 423/857] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:27.249160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.249446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.249723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.274815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:27.276033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:27.291201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.317834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8fc0f-8706-4294-973f-f7d52d906b01 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.328649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.346440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 424/858] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:27.347259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.358759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.359597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.359882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.360160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.360965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:27.361277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.362723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.372060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 435/859] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:27.372838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.464470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe574f6-3714-461e-8623-e8a184a228f9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.478408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d913e-7877-4403-bc0c-c148ae52c12d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.498673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.499438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.499717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.499994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.506865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.508347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.515025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.515998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.516483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.516939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.517884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.520012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:27.522393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:27.523473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:27.524409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 425/860] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:27.524898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.529533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.575921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.629487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce0ff-4d6b-4ba9-a270-c0558944786d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.644231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 436/861] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:27 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:27.645879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.695105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.696613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.697527 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.697985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.711688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.713393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:27.734554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:27.735739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:27.736877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:27.736877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:27.736877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:27.736877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:27.743975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 426/862] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:27.745267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.776745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1add46-cfc7-40a2-aa68-eb532f8916f3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.818563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.819748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.820037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.820314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.821436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:27.821800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.823497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.841918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 437/863] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:27.847569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.886762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.896607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69332-72ba-4a48-b816-615f189f0383 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:27.912621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:27.943700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:27.945115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:27.945402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:27.945678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:27.946405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:27.946724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:27.949526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:27.961211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 427/864] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:27.966355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:27.974278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f229db-a933-45d9-9c86-2958e8f93ad1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:28.020614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:28.022133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.022948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.023482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.024988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=35b1d5f68be34afc8a72843e869bc3b2) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:28.025664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:28.027670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da71db3-021c-4bcd-bdfa-327318825568 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:28.036523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 438/865] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/role_assignments?user.id=35b1d5f68be34afc8a72843e869bc3b2&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:28.080476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b6862-15e7-4e9e-8028-30a8b3f5b8fa None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:28.118671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:28.119548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.119833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.120106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.124844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbc59c-f772-4957-9edd-d0df791cb751 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.125183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbc59c-f772-4957-9edd-d0df791cb751 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.125413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbc59c-f772-4957-9edd-d0df791cb751 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.127299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 439/866] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:28.133685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.133881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:28.134414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.134903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.135272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:28.152408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:28.153418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:28.154338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 428/867] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:53:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:28.157098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:28.158290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:28.159427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:28.179283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:28.239585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 440/868] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:28.254638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:28.290913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25b847-9b92-4de7-ac26-0402d9efc872 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:28.309271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:28.341211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:28.341899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.342180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.342450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.343460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:28.343641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:28.345145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:28.368080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 429/869] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 08:53:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:28.369358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ac0e5-7689-4570-8b75-25c97554667e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:28.375583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:28.409351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:28.410184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.410958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.411351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.412092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:28.413675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:28.459127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:28.488678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198367f3-49d5-46e5-84a3-97a9cf6812fb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:28.531472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 441/870] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:28 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:28.539564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:28.540353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.540691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.541028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.624249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:28.625729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:28.698234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:28.744437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 430/871] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:28.750078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:28.856814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81e10-a155-47dc-bcd6-b3ed14e7cd0d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:28.867526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:28.893128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:28.893958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:28.894246 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:28.895071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:28.906608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:28.908760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:28.934169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:28.935044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:28.935950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:28.935950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:28.935950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:28.935950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:28.935950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 442/872] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:28.941289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:29.046169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c514af-2115-4ab9-9f30-cc61a52edec8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:29.085484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:29.086155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:29.086435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:29.086715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:29.087460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:29.087772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:29.089160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:29.102250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 431/873] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:29.107490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:29.209202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5b12-fe11-4b3b-95de-28d9a42d311f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:29.243823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:29.244628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:29.244914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:29.245191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:29.252322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:29.253879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:29.268478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:29.269864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:29.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 443/874] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:29.276136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:29.304838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:29.382740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4dab1-c426-4bf8-9b07-eec5d5b545f1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:29.418728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:29.419432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:29.419721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:29.419998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:29.420786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:29.421098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:29.422531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41bd6-141d-4ce6-9528-2c82dc208591 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:29.435066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 432/875] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:29.441049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:29.467696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:29.550439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292a6f-123c-4eff-8933-29aa2fc65e72 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:29.586845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:29.587909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:29.588429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:29.588910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:29.590003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=13e35a595b9646a28a26177eae068397) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:29.590521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:29.592304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa49204-7ab5-4cd0-b1d1-8e95d4769853 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:29.598902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 444/876] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:29 2022] GET /identity/v3/role_assignments?user.id=13e35a595b9646a28a26177eae068397&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:30.101206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa5d3-818e-4724-97a3-ea5ae0cdada9 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.102240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa5d3-818e-4724-97a3-ea5ae0cdada9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.102762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa5d3-818e-4724-97a3-ea5ae0cdada9 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.104638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 433/877] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:30.110187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.110713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.111206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.129305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:30.130814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:30.211462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 445/878] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:30.234786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fa5d3-818e-4724-97a3-ea5ae0cdada9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.327550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:30.342005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fa5d3-818e-4724-97a3-ea5ae0cdada9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:30.377282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:30.378386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.379366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.379834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.380691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:30.382307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-c8711eb8-26bf-4b8c-a50c-345baedc8da2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:30.395956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:30.397090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:30.397993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:30.411305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 434/879] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:30.412494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.432407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:30.522204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce577270-9ccf-4d78-8dfb-18e8921ab3df None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:30.528721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4bbcd-0b5d-41a4-ba34-a90fc07186c6 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.529023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4bbcd-0b5d-41a4-ba34-a90fc07186c6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.529301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4bbcd-0b5d-41a4-ba34-a90fc07186c6 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.530808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 435/880] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:30.536545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.537125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.537658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.556135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:30.557389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:30.565317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:30.567038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.567679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.567951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.568663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:30.568968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:30.570509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:30.575937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 446/881] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:30.581983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.639378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 436/882] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:30.661198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.674745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:30.704106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6277da-4692-4f0a-8061-d9ed7fafa99e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:30.748397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:30.749078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.749365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.749646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.750869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:30.751196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:30.752863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:30.759989 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:30.763304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 447/883] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:30.767255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.786779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158c757-6315-4950-b072-9ea8d564f556 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:30.827321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:30.828275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.828642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.828986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.829802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:30.831514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:30.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:30.850346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:30.851172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:30.855320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 437/884] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:30.856642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.904985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadd48-b719-4494-82f8-91d358f2c20a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:30.953536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:30.954939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:30.955690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:30.956139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:30.957970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] RBAC: Adding query filter params (interface=public, service_id=5add717404164580b5d162807c3f8983, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:30.958900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:30.960772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:30.967891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34208-62c7-434a-a81e-dd8269d9b279 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:30.973164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 448/885] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/endpoints?service_id=5add717404164580b5d162807c3f8983&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:30.975188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:30.987610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:31.020687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.021905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.022344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.022940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.024216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:31.024703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.026761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19c9c4-0b6c-4baa-b826-e156396c1777 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.033365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 438/886] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:31.034389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b0d0-728c-4ce7-9971-171329f6d745 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.034681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b0d0-728c-4ce7-9971-171329f6d745 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.034999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81b0d0-728c-4ce7-9971-171329f6d745 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.036548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 439/887] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:31.041511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b0d0-728c-4ce7-9971-171329f6d745 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:31.053972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:31.088891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a13dc-016f-4ccc-b385-630ce73b9f8a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:31.123570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45c67-96e3-4975-ac6a-79d4b1d7d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.124231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45c67-96e3-4975-ac6a-79d4b1d7d41f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.124520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45c67-96e3-4975-ac6a-79d4b1d7d41f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.124803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45c67-96e3-4975-ac6a-79d4b1d7d41f None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.125562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45c67-96e3-4975-ac6a-79d4b1d7d41f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.127156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45c67-96e3-4975-ac6a-79d4b1d7d41f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.133401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 449/888] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:30 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 08:53:31.141565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.142219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.142927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.155125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81b0d0-728c-4ce7-9971-171329f6d745 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:31.170533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:31.173090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:31.195166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.195893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.196180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.196892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.197242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:31.197555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.199000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.211261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 440/889] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:31.270774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 450/890] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:31.294692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:31.391657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:31.420342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e65d-f232-41b1-84ac-6a7cb1f885ef None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:31.459914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.461111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.461614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.462104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.462982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.464623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:31.478528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:31.479569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:31.480405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:31.483336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 441/891] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 2 08:53:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:31.495287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:31.495287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:31.593901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c2778-247e-46e5-b1ab-18e221254126 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:31.629290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.629972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.630256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.630533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.631276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:31.631582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.632976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.638536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 451/892] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:31.644133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:31.756451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1719-cd8a-42f4-88dc-869f50ec21f0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:31.795837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.796669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.796958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.797234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.797934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:31.798238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.799640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.805171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 442/893] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:31.810651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:31.880776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:31.916232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d028da-e6fa-4b13-b5aa-35bc4c5a3791 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:31.954016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:31.954685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:31.954961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:31.955250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:31.956039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] RBAC: Adding query filter params (interface=public, service_id=bc2b168332754bf88d7e5937ed7442df, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:31.956348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:31.957795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906a58-63ab-41c6-88ce-84fbc997f0f3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:31.963553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 452/894] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:31 2022] GET /identity/v3/endpoints?service_id=bc2b168332754bf88d7e5937ed7442df&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:31.972387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:31.975564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:32.001196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cad08-dd3a-45f7-af51-e9db32023f72 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.001937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cad08-dd3a-45f7-af51-e9db32023f72 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.002309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cad08-dd3a-45f7-af51-e9db32023f72 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.005268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 453/895] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:32.010350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.011363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.011363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.029614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:32.030812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:32.090503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4e4b7-d456-4398-92c7-4d3f05177149 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:32.127393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 454/896] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:32.133384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:32.134296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.134798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.135317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.136253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:32.138004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:32.144661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 443/897] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:31 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 08:53:32.152447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:32.220362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:32.265658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63c76-cc60-46a5-af23-e553ae614de0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:32.304272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:32.305097 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.305381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.305724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.317541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:32.326110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:32.327111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:32.327994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 455/898] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 08:53:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:32.333751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:32.409121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:32.448254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2effee5-94c9-4e2c-a348-0dca2c371fb3 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:32.484431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:32.485108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.485391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.485665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.486407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:32.486708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:32.490510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:32.500195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 444/899] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:53:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:32.505718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:32.617111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256e1d-18e3-428d-9143-58d4fa7ebab5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:32.637410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:32.652923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:32.654000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.654511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.654992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.666764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:32.668588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:32.686165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:32.687098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:32.688123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:32.688123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:32.688123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:32.688123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:32.690359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 456/900] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:32.695831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:32.803426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae59d-c69d-4f4c-a3e7-017e9fee6980 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:32.832128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:32.840280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:32.840966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:32.841257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:32.841538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:32.842265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:32.842574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:32.843988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:32.856680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 445/901] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:32.862376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:32.978985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ecc07-b0c8-4a38-b9f4-105fc0035b14 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:33.015346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:33.016178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.016465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.016745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.024990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:33.026458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:33.041905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:33.042909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:33.043893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 457/902] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:53:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:33.048999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:33.155355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a2097-ad39-4361-8dcc-77f2ba848b37 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:33.196114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:33.196737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.197025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.197302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.198173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:33.198486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:33.200001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0dc14-987d-4bf6-a215-71f5a61f7543 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:33.219119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 446/903] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 08:53:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:33.225280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:33.263066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:33.335057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725867-e535-4c4c-af1c-52308058ad20 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:33.369869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:33.370909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.371416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.371876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.445222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:33.446864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:33.495873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:33.514645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af0029-ddb2-46a6-b3d9-a04b2aada597 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.515741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af0029-ddb2-46a6-b3d9-a04b2aada597 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.516102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af0029-ddb2-46a6-b3d9-a04b2aada597 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.517900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 447/904] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:33.524501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185099-723f-4240-8704-a642ddd08967 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.524877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185099-723f-4240-8704-a642ddd08967 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.525233 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185099-723f-4240-8704-a642ddd08967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.542739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-67185099-723f-4240-8704-a642ddd08967 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:33.544073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-67185099-723f-4240-8704-a642ddd08967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:33.563253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 458/905] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:33.576257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:33.590987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:33.619175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 448/906] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:33.620622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a542-9380-4371-97ad-4832464f671b None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.621366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a542-9380-4371-97ad-4832464f671b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.621999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a542-9380-4371-97ad-4832464f671b None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.624389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 449/907] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:33.631447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.631851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.632228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.651178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:33.652393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:33.697478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32500819-1f39-4c5d-a437-db348f877a57 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:33.719222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 450/908] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:33.720082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:33.745828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:33.752795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:33.754247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.754532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.756464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.764826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:33.766298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:33.784402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:33.785979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:33.787175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:33.787175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:33.787175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:33.787175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:33.788556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 459/909] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:33.793131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:33.830838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc13c3b-8ca6-4c33-914d-06da126ff7f7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:33.838095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:33.866408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:33.867205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.867514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.867784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.868432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:33.869799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:33.882548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:33.883578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:33.884456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 451/910] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:33.885269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:33.900759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028bdfa-9f9d-4f0f-9ae0-ef30d90df2cd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:33.937887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:33.938563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:33.938851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:33.939131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:33.939983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:33.941498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:33.993896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625853-8e91-48cc-a9a2-e25f41605542 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.015959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 460/911] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:33 2022] POST /identity/v3/services => generated 241 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:34.017037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.056498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.058238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.058778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.059248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.060434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:34.061404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.063361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.080585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 452/912] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:34.082921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:34.096933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.137232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:34.163445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4cc1b-389a-4229-9a2a-0b2e0f44b3c5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.205597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.206294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.206581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.207440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.208172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:34.208485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.210501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.216148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 461/913] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:34.221908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.242756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bbb33-262e-407c-80f2-e224248cf11e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.281838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.282563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.282847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.283121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.293067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.297636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:34.315214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:34.316335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:34.317229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 453/914] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:34.322458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.376081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191de49-1acf-4418-b162-a98b8e376a81 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.388411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:34.420701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.421535 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.421913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.422401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.423353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:34.423756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.424453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:34.426121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.435762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 462/915] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 2 08:53:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:34.437686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.454110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464e0b2-c12d-41cb-b531-dbb5ca0c4398 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.508798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.509839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.510358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.510862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.512074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:34.513124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.515065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.529966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:34.539348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.550297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0198c-1cd2-4da8-9526-47bd996d9e11 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.593755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a8255-fd8d-4e7e-892b-d2bb316ac7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.594479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a8255-fd8d-4e7e-892b-d2bb316ac7bc None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.594797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a8255-fd8d-4e7e-892b-d2bb316ac7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.595145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a8255-fd8d-4e7e-892b-d2bb316ac7bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.595956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a8255-fd8d-4e7e-892b-d2bb316ac7bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.597380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a8255-fd8d-4e7e-892b-d2bb316ac7bc None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.654556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680a91-d42d-40e0-a266-7c6938b6088e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.664743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 463/917] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:34.667264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c551-adf5-432c-9ec7-0dd5739bef4b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.667264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c551-adf5-432c-9ec7-0dd5739bef4b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.667264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c551-adf5-432c-9ec7-0dd5739bef4b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.669537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 464/918] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:34.678151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.678809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.679090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.702445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:34.703919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:34.711065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.711763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.712052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.712317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.713231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] RBAC: Adding query filter params (role.id=c463252a8786458197059539c3e71d63, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=13e35a595b9646a28a26177eae068397) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:34.713637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.715154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:34.722867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 455/919] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:34 2022] GET /identity/v3/role_assignments?user.id=13e35a595b9646a28a26177eae068397&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=c463252a8786458197059539c3e71d63 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:34.736378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:34.788184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:34.812222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:34.822398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:34.942615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7333aa2-605b-4a75-b047-81785ceef8de None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:34.984559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:34.985382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:34.985669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:34.985941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:34.986591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:34.988568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:35.001089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:35.002288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:35.003486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 456/921] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 2 08:53:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:35.009422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:35.115712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d4e7e-6226-447a-bfe8-c828364e5c70 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:35.150851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:35.151567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:35.151858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:35.152142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:35.152867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:35.153178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:35.154580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:35.160802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 466/922] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:35.169110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:35.241790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:35.283227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7d655-c7ae-499d-b674-4ca15fa12fff None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:35.321734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:35.322661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:35.323095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:35.323548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:35.324418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:35.324894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:35.326418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dfe70-c4d1-44b7-a18f-830cb4b892d5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:35.332380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 457/923] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:35.339726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:35.363943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:35.444013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb7e65-da48-46d5-81ab-60c8ed52f52f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:35.479948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623b48-a1cc-4931-befc-9c2d0766f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:35.480615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623b48-a1cc-4931-befc-9c2d0766f436 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:35.480904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623b48-a1cc-4931-befc-9c2d0766f436 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:35.481186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623b48-a1cc-4931-befc-9c2d0766f436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:35.481932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623b48-a1cc-4931-befc-9c2d0766f436 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:35.483333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623b48-a1cc-4931-befc-9c2d0766f436 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:35.605970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 467/924] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:36.454844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5be43-10fa-407e-9dc0-bb45be6113fd None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:36.454844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5be43-10fa-407e-9dc0-bb45be6113fd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:36.455488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5be43-10fa-407e-9dc0-bb45be6113fd None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:36.456526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 458/925] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:36.462940 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:36.463262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:36.463544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:36.482985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:36.484217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:36.600285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 468/926] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:36.639678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5be43-10fa-407e-9dc0-bb45be6113fd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:36.870379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5be43-10fa-407e-9dc0-bb45be6113fd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:36.941659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:36.942485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:36.942770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:36.943047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:36.947590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:36.948979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:36.956026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a7ca2692-0685-45dc-9fca-32e4a54d5bd9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:36.977970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:36.979031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:36.979936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:36.985385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:36.987417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 459/927] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:36.996687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.106177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67f1d7-4e8c-4a00-86f6-176185e3a765 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.145762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.146785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.147297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.147791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.148693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:37.149207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.150804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.156249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 469/928] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:37.156395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73119fb-3db4-49b0-be95-6967f78ddef4 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.156614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73119fb-3db4-49b0-be95-6967f78ddef4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.156894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73119fb-3db4-49b0-be95-6967f78ddef4 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.158363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 460/929] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:37.163781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.168451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0931d3-b61f-4720-b0e3-62eec42ae512 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.168451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0931d3-b61f-4720-b0e3-62eec42ae512 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.168451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0931d3-b61f-4720-b0e3-62eec42ae512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.186198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2b0931d3-b61f-4720-b0e3-62eec42ae512 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:37.187450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2b0931d3-b61f-4720-b0e3-62eec42ae512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:37.237667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.267385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 461/930] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:37.269135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dfb9e-0549-4614-9485-406a4f53a2d4 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.269420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dfb9e-0549-4614-9485-406a4f53a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.269696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dfb9e-0549-4614-9485-406a4f53a2d4 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.271137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 462/931] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:37.276673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.276985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.277512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.279564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7e2f0-1cb9-4120-821b-ea8c7b11e3fe None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.295567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:37.296745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:37.318250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.318924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.319377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.319655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.320358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:37.320667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.322045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.332334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 470/932] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:37.332334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.374400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 463/933] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:37.375256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.436320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.441052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538434a-e816-4377-979a-aad18115f5cd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.471675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.477096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.477908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.478190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.478471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.482123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4d864-2eb5-475d-b16c-6edffd9cd6df None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.489664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:37.499331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:37.500458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:37.501799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.509086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 471/934] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:37.509086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.525928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.526598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.526883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.527158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.527973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] RBAC: Adding query filter params (interface=public, service_id=cb0f1ff9116142648ebbe4572bcd1e19, region_id=RegionOne) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:37.528284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.529657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.535456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 464/935] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/endpoints?service_id=cb0f1ff9116142648ebbe4572bcd1e19&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:37.535456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.621386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171c5a-4bae-47df-b381-a956c8f9a316 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.639877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e92b1-c71d-42d2-9ef0-c8e8bb6a63e8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.657498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.658277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.658558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.658867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.659582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.661551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.663039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING keystone.server.flask.common [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 08:53:37.664882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.681039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.681752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.682035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.682374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.683197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:37.683516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.685694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.698278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 465/936] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:37.698278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.717764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.sql.core [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 08:53:37.717764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 08:53:37.717764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [parameters: {'id': '13c35cb0c6d84a868379f50bcb26baaf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 08:53:37.717764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13c35cb0c6d84a868379f50bcb26baaf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13c35cb0c6d84a868379f50bcb26baaf. Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 08:53:37.740335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 08:53:37.741175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application yield resource Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise self.value Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application session.commit() Jun 02 08:53:37.742167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.flush() Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application compat.raise_( Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 08:53:37.743049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 08:53:37.744978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 08:53:37.747183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [parameters: {'id': '13c35cb0c6d84a868379f50bcb26baaf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:37.750415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:37.752623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13c35cb0c6d84a868379f50bcb26baaf. Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 472/937] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jun 2 08:53:37 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:37.755445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.802041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.806800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a8b1-bd43-41ff-bd08-09f5c3cff4f1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.839682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.840346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.840625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.840902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.841572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.842946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.849394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 466/938] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 08:53:37.850176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.869336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a20949-361c-4a1a-ad08-81a77c35d4bf None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:37.909587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:37.911503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:37.911855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:37.912248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:37.922090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:37.937642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:37.941105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:37.963390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:37.964484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:37.965580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:37.965580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:37.965580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:37.965580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:37.967558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 473/939] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:37.978283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:37.997103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc172-25ac-4cea-b5f6-635041ab0fe5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.037025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.037835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.038124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.038393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.045983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.047706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3f545b1f-be46-4bbe-aa91-49be2e55582b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:38.063741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:38.064895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:38.066035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:38.068318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 467/940] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:38.069704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303bcd-9902-4fc7-bc71-d50d8ebdfe2f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.069704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303bcd-9902-4fc7-bc71-d50d8ebdfe2f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.069704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03303bcd-9902-4fc7-bc71-d50d8ebdfe2f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.071057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 468/941] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:38.072827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03303bcd-9902-4fc7-bc71-d50d8ebdfe2f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.095828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:38.098942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd7b06-755a-4250-8547-db42e0e01fe4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.142909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.144114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.144551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.144999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.146132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:38.147182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.149058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d4844-9579-4c40-b8c5-fda06a620d18 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.169306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 474/942] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:38.171164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.171870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.172758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.182477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03303bcd-9902-4fc7-bc71-d50d8ebdfe2f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.191909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:38.192415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:38.194427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:38.217947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.218530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.218857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.219185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.219967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:38.220273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.221695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.239974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 469/943] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:38.240807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.274939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 475/944] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:38.297911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.380544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd54abb-eae1-444f-ab28-5289c6b06e9b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.422883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.424182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.424467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.424751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.436890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.437345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01812c0-73ce-4274-b9cb-842fef3366f8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.439646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.440798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:38.460291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:38.461498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:38.462676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 470/945] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:38.466565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.491460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.492199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.492484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.492761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.493628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.495400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.502613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:38.509763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:38.510869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:38.511800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 476/946] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:38.517249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.594758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b467-40d5-42c1-8c6e-f5ea97802023 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.630903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.631890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.632317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.632757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.633742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:38.634191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.635805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.642987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04b0a-9aec-4a0a-94d7-3108ede23425 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.659322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 471/947] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:38.664827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.689410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.690088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.690375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.690656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.692408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:38.692726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.694454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.701536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 477/948] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:38.707474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.734734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:38.773524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:38.790000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c34ba-870f-4c5a-8b76-fba6a54918b8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.828202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.829490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.830066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.830533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.833521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809207-ad46-48fa-9532-37ab1d813e99 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:38.842324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.844245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:38.864112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:38.865052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:38.865933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:38.865933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:38.865933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:38.865933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:38.872345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 472/949] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:38.873701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:38.877840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:38.878551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:38.878841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:38.880008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:38.880752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:38.881059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:38.882457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:38.888349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 478/950] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:38.998119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4fad-9c2e-48f6-9814-cbe94c2db0ab None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:39.041365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:39.042423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:39.042917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:39.043415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:39.044362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:39.044864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:39.046457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:39.054424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:39.061921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 473/951] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:39.068714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:39.160360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:39.179416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdd774-7af8-4ead-8938-a7a8dee17149 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:39.218499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:39.219489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:39.219868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:39.220239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:39.227348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:39.228936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:39.243597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:39.244724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:39.245654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:39.246444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 479/952] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:39.251996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:39.358337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3660b-4da3-43a3-bad5-5a4313205ae4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:39.393617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:39.394822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:39.395103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:39.395404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:39.396181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:39.396546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:39.398039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63441-2e59-4504-a08a-a011cb67002d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:39.411616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 474/953] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:39.417508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:39.525152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6bb4c-fbb5-4ef0-85f8-864a67b9e8f3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:39.561295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfbceb-0377-4813-b0eb-4a9cec8f2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:39.562613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfbceb-0377-4813-b0eb-4a9cec8f2f36 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:39.563133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfbceb-0377-4813-b0eb-4a9cec8f2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:39.563703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfbceb-0377-4813-b0eb-4a9cec8f2f36 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/13e35a595b9646a28a26177eae068397/roles/c463252a8786458197059539c3e71d63` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:39.566264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfbceb-0377-4813-b0eb-4a9cec8f2f36 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=13e35a595b9646a28a26177eae068397, role_id=c463252a8786458197059539c3e71d63)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:39.567937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfbceb-0377-4813-b0eb-4a9cec8f2f36 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:39.651000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 480/954] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:39 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/13e35a595b9646a28a26177eae068397/roles/c463252a8786458197059539c3e71d63 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:40.186644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775177-e8af-41be-bfbc-7b033a9b615d None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.187153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775177-e8af-41be-bfbc-7b033a9b615d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.187153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775177-e8af-41be-bfbc-7b033a9b615d None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.188731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 475/955] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:40.194834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.195307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.195582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.200948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:40.213109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:40.214388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:40.283182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 481/956] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:40.306508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775177-e8af-41be-bfbc-7b033a9b615d None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:40.370633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:40.417981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775177-e8af-41be-bfbc-7b033a9b615d None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:40.453319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:40.454369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.454796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.455323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.456113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:40.458192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:40.470668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:40.472037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:40.473655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:40.476105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 476/957] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:40.482181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:40.589910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fe07f-deda-4f66-8e96-e89cac4a19d2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:40.620582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:40.626594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:40.627462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.627888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.628847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.629692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:40.630212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:40.631861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82653aa-9213-4cc1-b331-0ed5451dc7b1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:40.643320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 482/958] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:40.645166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:40.649156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c70c-25a0-4640-a0a9-0678ce7199e7 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.649457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c70c-25a0-4640-a0a9-0678ce7199e7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.649739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c70c-25a0-4640-a0a9-0678ce7199e7 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.651392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 483/959] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:40.656375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.656667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.656954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.677828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:40.679275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:40.752359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 484/960] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:40.771298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d327a2a-3aa8-44f9-8019-498df4621dbc None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:40.777460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:40.805762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:40.809592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:40.810708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.811185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.811700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.812694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:40.813210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:40.814883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:40.821108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 477/961] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:40.826928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:40.887055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6343c6-7053-490a-85ad-3fb0da472e45 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:40.916580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:40.938215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:40.939906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.940346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.941885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.942818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:40.945746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:40.953657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433efef-f857-4532-a661-71f9095bd9ca None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:40.991970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.sql.core [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 08:53:40.991970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 08:53:40.991970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [parameters: {'user_id': '0a0e346ac79f4e4280ff7ca6fdb5bd00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 08:53:40.991970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 08:53:40.994899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:40.995714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:40.996147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:40.996518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:40.997371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:40.998925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jun 02 08:53:41.001853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 08:53:41.002852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application yield resource Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application next(self.gen) Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise self.value Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application session.commit() Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 08:53:41.004453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.session.flush() Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application compat.raise_( Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 08:53:41.005343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 08:53:41.006205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application conn.query(q) Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application result.read() Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 08:53:41.007062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [parameters: {'user_id': '0a0e346ac79f4e4280ff7ca6fdb5bd00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:41.010279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 08:53:41.012784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 485/962] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 2 08:53:40 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:41.014895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:41.079265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 478/963] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:41.136638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0616ae-1e9f-4eea-b8d0-bebeb6e5e110 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:41.187001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:41.187840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:41.188123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:41.188398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:41.197456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:41.199165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-270341a2-36bd-4655-ae78-e801d764cbae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:41.215471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:41.216492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:41.217434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 486/964] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:41.224736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:41.259285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67247247-c0ba-49f5-ba68-d7f26421beb9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:41.259580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67247247-c0ba-49f5-ba68-d7f26421beb9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:41.259780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67247247-c0ba-49f5-ba68-d7f26421beb9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:41.262135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 487/965] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:41.269338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:41.270653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:41.271025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:41.281653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:41.291554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:41.293187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:41.345809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:41.362114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75874ea3-7b97-4de0-9306-989d00a89a01 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:41.382420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 488/966] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:41.400663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:41.413514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:41.414946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:41.415478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:41.416215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:41.417476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:41.418009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:41.420433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8f02-7fa5-4767-b608-611a2edfde9d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:41.475465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 479/967] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 2 08:53:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:41.525774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e72ce-26d7-4f22-8abf-144bf9f1e60f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:41.563796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00c51-c18e-48e4-929e-a02ae1e5a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:41.564487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00c51-c18e-48e4-929e-a02ae1e5a93d None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:41.564766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00c51-c18e-48e4-929e-a02ae1e5a93d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:41.565039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00c51-c18e-48e4-929e-a02ae1e5a93d None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:41.566350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb00c51-c18e-48e4-929e-a02ae1e5a93d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:41.568025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb00c51-c18e-48e4-929e-a02ae1e5a93d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:41.631349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 489/968] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:41 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:53:42.035831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9024-aefd-4185-b960-39c2c3610557 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:42.036171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9024-aefd-4185-b960-39c2c3610557 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:42.036431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9024-aefd-4185-b960-39c2c3610557 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:42.037840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 480/969] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:42.042925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:42.043218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:42.043521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:42.060499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:42.061661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:42.099318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:42.146081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 490/970] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:42.169948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9024-aefd-4185-b960-39c2c3610557 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:42.276253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:42.281551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9024-aefd-4185-b960-39c2c3610557 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:42.318216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:42.319568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:42.319853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:42.320134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:42.331537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:42.343702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:42.344783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:42.345628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:42.347556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 481/971] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 08:53:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:42.353228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:42.454773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9adeb-a980-45c2-b6ab-3fde7875527b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:42.489647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:42.490326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:42.490612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:42.490892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:42.491682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:42.491995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:42.493606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:42.503432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 491/972] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:53:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:42.508065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:42.609888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac275c0-eb49-4892-bc30-ce45c2510790 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:42.643535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:42.644927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:42.645220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:42.645498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:42.656448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:42.657927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:42.675868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:42.676780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:42.677703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:42.677703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:42.677703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:42.677703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:42.678594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 482/973] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:42.682691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:42.709006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:42.788175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f9e30-256d-4026-af29-c6081833b1a8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:42.824443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:42.825425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:42.825892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:42.826386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:42.827339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:42.827830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:42.829406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:42.845451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 492/974] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:42.851066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:42.867395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:42.965936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e013f0e-e6d8-4e27-8884-7c4d7505b1c6 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:42.999104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:42.999943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.000231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.000507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.008775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.010237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:43.025242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:43.026205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:43.027195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 483/975] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:53:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:43.033881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.120374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.139180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5bb3c-a400-4083-8f9c-d8aaf9b4be76 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:43.173037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:43.173834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.174214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.174587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.176082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:43.176508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.178025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a907da-0a4a-452c-bf93-610e57feee92 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.196019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 493/976] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:43.201351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.276558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.308387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a572f-2f9c-4e6b-9a44-6af3d6962f9c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:43.342384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:43.343126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.343497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.343836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.411703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.413236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.429997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82356c-32f3-46a2-abf3-4deaf14dc212 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.430512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82356c-32f3-46a2-abf3-4deaf14dc212 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.430630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82356c-32f3-46a2-abf3-4deaf14dc212 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.432109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 494/977] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:43.436890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.437207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.437453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.453638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:43.454812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:43.484693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.519675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 484/978] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:43.524620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 495/979] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:43.525065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.548225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.626131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.634654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8eaab-a753-4c69-b71d-a8f123edf4bd None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:43.664283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb5a4-e7cd-49cf-bede-0476c97320a8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:43.676119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:43.677197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.677483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.677913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.692392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.694485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.698702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:43.699533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.699821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.700091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.700737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.702093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:43.713183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:43.714138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:43.715062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:43.715062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:43.715062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:43.715062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:43.715827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:43.722685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:43.723542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 496/980] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:43.724326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 485/981] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:43.724395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.725684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.756232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.825433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a987c-950d-4891-986b-5bcc519af896 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:43.839488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f63d75-e34c-4e77-aa7c-8b6f752ca4e0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:43.858689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:43.859384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.859668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.859937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.860654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:43.860958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.862332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.864391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.875097 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 497/982] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:43.879738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:43.880815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:43.881317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:43.881444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.881970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:43.882857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:43.883374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:43.884937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:43.894996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 486/983] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:43.896365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:43.989401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:43.995311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb3ea-87ec-4124-b35b-5978a6fbfe70 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.000965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9697-d184-499e-b413-8b038ab1384e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.030048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.030847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.031130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.031439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.035062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.035757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.036042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.036322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.037049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.037360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.038061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.038732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d26fa9-dc8e-42cc-9a15-2e08c2476cad None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.039517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.043496 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 487/984] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:44.044769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b2048-15ec-40e9-b9ed-a1cc3cc8718e None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.045072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b2048-15ec-40e9-b9ed-a1cc3cc8718e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.045346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b2048-15ec-40e9-b9ed-a1cc3cc8718e None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.046723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 488/985] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:44.049251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b2048-15ec-40e9-b9ed-a1cc3cc8718e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d3a66d95-8cbe-4fd1-89c8-34fe5c2f7d07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:44.053765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:44.054821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:44.055770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 498/986] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:44.056591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.056704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.056939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.073459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:44.074629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:44.122760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:44.155257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 499/987] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:44.155257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.156226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b2048-15ec-40e9-b9ed-a1cc3cc8718e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.190155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.191308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.191592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.191869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.192664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] RBAC: Adding query filter params (interface=admin, service_id=cb0f1ff9116142648ebbe4572bcd1e19, region_id=RegionOne) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.192978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.194356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.199332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 489/988] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/endpoints?service_id=cb0f1ff9116142648ebbe4572bcd1e19&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:44.200172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.216920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:44.242958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec77912-daa2-42a9-99ee-19ee3da4f262 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.276339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.277002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.277288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.277566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.278354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.278663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.280166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.292082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 500/989] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:44.292690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.302348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055d4fe-6b42-4232-a2ff-b691add5d3a2 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.335123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.335946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.336230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.336508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.337160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.337432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:44.338546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:44.351788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:44.352817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:44.353692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:44.354691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 490/990] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:44.355677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.391699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490317-a667-4f0a-af8e-5b7b0724582a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.424250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.425038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.425788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.426072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.426742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.428136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.434240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 501/991] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 08:53:44.435009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.448723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:44.461142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d01888-4369-49b1-a8c0-c3c586ea160b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.503173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.503999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.504285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.504565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.505417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] RBAC: Adding query filter params (role.id=c463252a8786458197059539c3e71d63, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=13e35a595b9646a28a26177eae068397) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.505732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.507565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.523562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 491/992] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/role_assignments?user.id=13e35a595b9646a28a26177eae068397&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=c463252a8786458197059539c3e71d63 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:44.552662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120889-b5a7-4633-bc72-7ea41d58e096 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.593294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:44.622803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.623697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.624093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.624477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.625606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.626229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.628469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.639065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 502/993] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:44.640483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.754588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109f761-cc2f-4694-869d-1c3133543de8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.790892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.791661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.791945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.792221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.792929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.793234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.794600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.799755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 492/994] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:44.805304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.906641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270dd9-56d9-41c9-a2d9-19a6b1505796 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:44.951653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:44.952310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:44.952598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:44.952879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:44.953682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] RBAC: Adding query filter params (interface=public, service_id=92473c0420194e639eeaeeaa34d75227, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:44.954003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:44.955448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd94-5db5-4160-b64b-e16fb5a94c88 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:44.961603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 503/995] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/endpoints?service_id=92473c0420194e639eeaeeaa34d75227&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:44.966895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:44.978966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:45.071675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063a388-9bdd-4429-81d7-0088e0965b14 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:45.105195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f4bbe-b5b2-412a-a037-4ed3797fc3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:45.105864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4bbe-b5b2-412a-a037-4ed3797fc3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:45.106150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4bbe-b5b2-412a-a037-4ed3797fc3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:45.106425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4bbe-b5b2-412a-a037-4ed3797fc3f5 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:45.107093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f4bbe-b5b2-412a-a037-4ed3797fc3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:45.108495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f4bbe-b5b2-412a-a037-4ed3797fc3f5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:45.123285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 493/996] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:44 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 08:53:46.704505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf481-5e9a-4bf5-9c8d-5b09ee4b130a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:46.705031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf481-5e9a-4bf5-9c8d-5b09ee4b130a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:46.705107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedf481-5e9a-4bf5-9c8d-5b09ee4b130a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:46.706516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 504/997] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:46.711892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:46.712341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:46.712511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:46.729540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:46.730719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:46.797774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 494/998] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:46.817167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352fb0-e89b-4909-a893-43fb393e3a48 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:46.817460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352fb0-e89b-4909-a893-43fb393e3a48 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:46.817745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352fb0-e89b-4909-a893-43fb393e3a48 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:46.819270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 505/999] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:46.820762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:46.823096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:46.824009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:46.824259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:46.824546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:46.846492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:46.848240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:46.878833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:46.925393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1009f-c014-476b-bdd2-d2b0c5d9d190 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:46.930304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 506/1000] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:46.952233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:46.959445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:46.960208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:46.960497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:46.960779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:46.961433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:46.962819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:46.975651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:46.976655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:46.977519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 495/1001] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 2 08:53:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:46.982727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.055532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:47.067864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3f59-ba21-4c82-8a79-2fc2904024e8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.095540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d7ae-fdb9-44d9-9398-2f4684f28d82 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.104591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.105392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.105678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.105957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] PATH_INFO: `/v3/services/image` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.106609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.108012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:47.119955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:47.120981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:47.121830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 507/1002] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 2 08:53:46 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:47.127175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.134748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.135456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.135744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.136024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.136733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:47.137044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.138425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.144484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 496/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:47.149734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.163041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:47.234863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ecc1a-f59c-4ac5-ac57-2b67a2898133 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.256678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430a91-a1e2-492f-a33a-30e7b4049367 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.276054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.277095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.277576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.278036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.278817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:47.279123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.280741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.286106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:47.292064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 508/1004] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:47.292685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.293363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.293470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.293711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.301023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.301023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:47.301023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.301023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.304247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 497/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 2 08:53:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:47.309379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.391620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:47.398628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb1f65-54ea-40bb-877a-0cb35fb8b9b7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.409870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c770-8c0a-40fe-8604-14e9e760d616 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.432150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.432723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.433018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.433297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.434000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] RBAC: Adding query filter params (type=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:47.434310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.435717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e9c52-0114-4ede-988d-037f639555ce None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.440120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 509/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:47.441457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382a3e0-ef44-4bb9-a6dc-24d6e2799c11 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.441751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382a3e0-ef44-4bb9-a6dc-24d6e2799c11 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.442035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382a3e0-ef44-4bb9-a6dc-24d6e2799c11 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.443313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 510/1007] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:47.448500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.449170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.449274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.449446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.449540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.449709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.449782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.450478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.452083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.467571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:47.468875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:47.543017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 511/1008] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:47.543718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 498/1009] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:53:47.567757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.678652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:47.692352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d9eec-21e0-4842-bec8-c37aeeb1da50 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.738497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.739439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.739726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.740213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.740734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.742242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:47.755899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:47.757142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:47.758165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 512/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:47.765095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:47.825380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:47.871730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367924c4-88d3-4a23-b325-09adcb42eb63 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:47.906535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:47.907209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:47.907525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:47.907808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:47.908512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:47.908823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:47.910758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:47.915916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 499/1011] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:47.921916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:48.029386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b244d-0413-4377-b400-ba70a1f47b68 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:48.062966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:48.063670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:48.063956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:48.064230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:48.064994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:48.065303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:48.067293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f6eb-7bb9-446e-aaa7-09a90b795a29 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:48.077024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 513/1012] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 2 08:53:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:48.077931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:48.185051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299081-b53f-4780-8392-5273bcd4e408 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:48.203473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:48.220960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd256d-9430-41ce-96ef-1c76530ca5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:48.221631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd256d-9430-41ce-96ef-1c76530ca5e3 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:48.221925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd256d-9430-41ce-96ef-1c76530ca5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:48.222198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd256d-9430-41ce-96ef-1c76530ca5e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:48.224151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd256d-9430-41ce-96ef-1c76530ca5e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:48.224389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd256d-9430-41ce-96ef-1c76530ca5e3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:48.307275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 500/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:49.704229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8173-aac2-4471-bb0d-89d55b49c1e7 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:49.704747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8173-aac2-4471-bb0d-89d55b49c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:49.704859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8173-aac2-4471-bb0d-89d55b49c1e7 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:49.706368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 514/1014] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:49.711455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b375-8ac7-40ae-83e1-ca982abe65b0 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:49.711836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b375-8ac7-40ae-83e1-ca982abe65b0 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:49.712018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b375-8ac7-40ae-83e1-ca982abe65b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:49.729441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e9f2b375-8ac7-40ae-83e1-ca982abe65b0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:49.730624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e9f2b375-8ac7-40ae-83e1-ca982abe65b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:49.805462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 501/1015] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:49.827010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e8173-aac2-4471-bb0d-89d55b49c1e7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:49.842509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:49.846003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583f76-fd17-45d4-a14d-9c97123ce003 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:49.846293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583f76-fd17-45d4-a14d-9c97123ce003 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:49.847086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583f76-fd17-45d4-a14d-9c97123ce003 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:49.848623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 502/1016] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:49.853739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:49.854250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:49.857817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:49.871676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:49.872861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:49.941732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e8173-aac2-4471-bb0d-89d55b49c1e7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:49.950438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 503/1017] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:49.975163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:49.976923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:49.977655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:49.977941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:49.978276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:49.979014 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:49.980516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:50.005506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:50.072324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 515/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:49 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:50.078577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b170a-427d-4602-9ee1-f334f3d56ce9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:50.128874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2a5e8-1000-4298-aa9a-a040c971f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:50.129687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2a5e8-1000-4298-aa9a-a040c971f493 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:50.129978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2a5e8-1000-4298-aa9a-a040c971f493 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:50.130258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2a5e8-1000-4298-aa9a-a040c971f493 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:50.131643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2a5e8-1000-4298-aa9a-a040c971f493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:50.133205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2a5e8-1000-4298-aa9a-a040c971f493 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:50.136825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 504/1019] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:50.141451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:50.221365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:50.256040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43a83-9679-455e-9d92-a9008adc3c79 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:50.295044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c012dd-0f66-4a4f-9bbe-4ee187a22d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:50.295749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c012dd-0f66-4a4f-9bbe-4ee187a22d51 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:50.296041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c012dd-0f66-4a4f-9bbe-4ee187a22d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:50.296324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c012dd-0f66-4a4f-9bbe-4ee187a22d51 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:50.297049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c012dd-0f66-4a4f-9bbe-4ee187a22d51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:50.298487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c012dd-0f66-4a4f-9bbe-4ee187a22d51 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:50.371397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 516/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:53:50 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:50.688666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c910c-2dac-4e55-a171-0482db67e197 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:50.688952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c910c-2dac-4e55-a171-0482db67e197 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:50.689410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c910c-2dac-4e55-a171-0482db67e197 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:50.691548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 505/1021] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:50.696615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:50.696915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:50.697200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:50.713803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:50.715004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:50.787274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 517/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:50.807574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c910c-2dac-4e55-a171-0482db67e197 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:50.904183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:50.912694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c910c-2dac-4e55-a171-0482db67e197 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:50.951092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:50.951904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:50.952191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:50.952465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:50.969076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:50.981431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:50.982363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:50.983202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:50.988020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 506/1023] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 08:53:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:50.989114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:51.047533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:51.090744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816872a2-857e-4f82-a6bd-700247e3a5da None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:51.124721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:51.125388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:51.125669 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:51.125942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:51.126937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:51.127264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:51.128650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:51.140873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 518/1024] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:53:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:51.142306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:51.247412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b2aab-3eaa-4c8e-8509-3a8f599a157b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:51.282884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:51.283728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:51.284044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:51.284324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:51.296935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:51.298397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:51.317412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:51.318374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:51.319772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:51.319772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:51.319772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:51.319772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:51.320259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 507/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:51.324259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:51.425470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7919-bbab-4326-8202-b28fc70a1933 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:51.441511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:51.458740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:51.459425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:51.459708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:51.459981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:51.460696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:51.460999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:51.462377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:51.475522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 519/1026] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:51.480961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:51.490751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:51.584286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81c3e-5ae3-4592-b0de-4333da8ac871 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:51.622563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:51.623393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:51.623685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:51.623966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:51.632793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:51.634289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:51.648844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:51.649796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:51.655444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 508/1027] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:53:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:51.657694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:51.760807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678fb1c-c6f6-4232-843e-f6acc33888b9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:51.794788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:51.795493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:51.795783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:51.796061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:51.796900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:51.797209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:51.798630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:51.820883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 520/1028] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:53:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:51.822359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:51.891783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:51.933171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ca8e9-3291-4769-a092-009c9b49bac7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:51.968013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:51.968676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:51.968963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:51.969242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.041435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.042927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.110144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:52.151841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 509/1029] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:52.155273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.189391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:52.257151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95220f-c040-4ee0-81bc-a3f7ab700219 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.292330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.293137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.293423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.293699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.304020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.305477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c26d91a9-472d-4d1a-a502-cd3d8c94e13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:52.322967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:52.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:52.329342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:52.329342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:52.329342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:52.329342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:52.329342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 521/1030] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:52.330018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.378337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f83250-6b04-4ee9-b7f6-3add2b878265 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.378627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f83250-6b04-4ee9-b7f6-3add2b878265 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.378910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f83250-6b04-4ee9-b7f6-3add2b878265 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.380392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 522/1031] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:52.385981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.386275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.386557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.403698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:52.404811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:52.442178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac0e19-dfc4-4ac9-b3a4-6a93bf33f3fd None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.477022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 523/1032] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:52.478802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.479659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.480009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.480363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.481161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:52.481541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.482991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.499358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 510/1033] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:52.499757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.500195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.519880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:52.530240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:52.605920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f64913-86e9-4fa1-b02e-2e033c47ee00 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.607262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03d47-9324-4bfb-93c8-4cb5a3d0e7e8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.641078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.641849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.642144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.642415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] PATH_INFO: `/v3/services/image` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.643045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.645079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.646829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.647663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.648001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.648285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.655269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.656674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:52.656865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:52.657822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:52.658754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 524/1034] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:52.664446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:52.675439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:52.676362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:52.677257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 511/1035] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:52.682233 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.750330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:52.767535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:52.768631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef443e4f-43eb-44c6-a66a-35d21a486323 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.781844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2951d-7880-4925-89a1-9617ffb3268e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.802865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.803574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.803866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.804151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.804863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:52.805180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.806611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8cdc5-e4e2-4c2c-928b-4b2653cdbff6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.811740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 525/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:52.812914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db75543-4775-4571-8299-d8d1b169624f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.813210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db75543-4775-4571-8299-d8d1b169624f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.813491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db75543-4775-4571-8299-d8d1b169624f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.814723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 526/1037] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:52.819450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.819824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db75543-4775-4571-8299-d8d1b169624f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.820123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.820412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.820805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.821599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:52.821910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.824430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9194fc6-b800-4746-ab78-f460aff9a299 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.837181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 512/1038] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:52.838574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.838866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.839280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.856218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:52.857411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:52.925253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db75543-4775-4571-8299-d8d1b169624f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:52.947326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 513/1039] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:52.947326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.960141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:52.960816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:52.961096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:52.961379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:52.962089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:52.962401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:52.963859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:52.973251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 527/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:52.973251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:52.979898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:53.012030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:53.034981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25488-e98f-4718-b320-f4af7c44a73f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:53.067355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44240c3-5d36-4dcb-a513-f935988811e8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:53.069760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:53.070407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:53.070689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:53.070963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:53.071816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] RBAC: Adding query filter params (role.id=c463252a8786458197059539c3e71d63, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=7d7ba842465543478b83e1bf3c018223) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:53.072129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:53.073544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:53.080164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 514/1041] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/role_assignments?user.id=7d7ba842465543478b83e1bf3c018223&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=c463252a8786458197059539c3e71d63 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:53.080979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:53.101884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:53.102718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:53.103005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:53.103314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:53.105183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:53.106725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:53.108615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 528/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:53.120682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:53.208576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401f0a6-7d47-4198-9c4f-6d1700115ab1 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:53.212213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:53.237938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ced23-d6de-4313-8bff-57ba2916a897 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:53.244856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:53.245537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:53.245826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:53.246106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:53.246917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] RBAC: Adding query filter params (interface=public, service_id=b58048e4204e42efb37f87035f9402db, region_id=RegionOne) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:53.247256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:53.248679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:53.255666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 515/1043] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:53:53 2022] GET /identity/v3/endpoints?service_id=b58048e4204e42efb37f87035f9402db&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:53.261146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:53.264922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:53.280239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73672693-2eb9-4793-870b-31c11a9a2d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:53.280932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73672693-2eb9-4793-870b-31c11a9a2d07 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:53.281285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73672693-2eb9-4793-870b-31c11a9a2d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:53.281635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73672693-2eb9-4793-870b-31c11a9a2d07 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:53.282981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73672693-2eb9-4793-870b-31c11a9a2d07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:53.289022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73672693-2eb9-4793-870b-31c11a9a2d07 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:53.370193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ac420-7976-4629-9d23-31dfdd81851b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:53.382261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 529/1044] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:53:53 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:53:53.410557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609fdd9-865d-4687-8bf2-ab38d96b893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:53.411551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609fdd9-865d-4687-8bf2-ab38d96b893c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:53.412017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609fdd9-865d-4687-8bf2-ab38d96b893c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:53.412444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609fdd9-865d-4687-8bf2-ab38d96b893c None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:53.413296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609fdd9-865d-4687-8bf2-ab38d96b893c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:53.414897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609fdd9-865d-4687-8bf2-ab38d96b893c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:53.431278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 516/1045] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:53:53 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 08:53:55.310882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11edcea-e8a4-4c47-95ff-5642b8accd02 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.311427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11edcea-e8a4-4c47-95ff-5642b8accd02 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.311427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11edcea-e8a4-4c47-95ff-5642b8accd02 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.312943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 530/1046] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:55.320488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.321923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.322320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.340281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:55.341490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:55.412967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:55.419261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 517/1047] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:55.442587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11edcea-e8a4-4c47-95ff-5642b8accd02 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:55.545108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11edcea-e8a4-4c47-95ff-5642b8accd02 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:55.574719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:55.580361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f7f85-5154-4566-96a0-f196504a56ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:55.581707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7f85-5154-4566-96a0-f196504a56ab None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.582011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7f85-5154-4566-96a0-f196504a56ab None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.582285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7f85-5154-4566-96a0-f196504a56ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.592931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f7f85-5154-4566-96a0-f196504a56ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-481f7f85-5154-4566-96a0-f196504a56ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:55.601193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:55.602092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:53:55.602935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:55.607276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 531/1048] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 08:53:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:55.608808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:55.696879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf66c2-1803-4916-a0d3-01973c321eef None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.697213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf66c2-1803-4916-a0d3-01973c321eef None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.697448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf66c2-1803-4916-a0d3-01973c321eef None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.698896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 532/1049] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:55.703925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30e22-7d58-42fc-8726-e1a98994b386 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.704216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30e22-7d58-42fc-8726-e1a98994b386 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.704491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30e22-7d58-42fc-8726-e1a98994b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.711012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6599b-5a3a-4d5e-946c-1d8fa00975dd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:55.721107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-69b30e22-7d58-42fc-8726-e1a98994b386 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:55.722893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-69b30e22-7d58-42fc-8726-e1a98994b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:55.746793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:55.747497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.747792 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.748071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.748815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:55.749127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:55.750545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13cf5b-e592-4229-b386-e5928f8fa072 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:55.759254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 518/1050] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:53:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:55.760320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d11591-2523-4b04-a8b1-8de533cce9cd None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.760609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d11591-2523-4b04-a8b1-8de533cce9cd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.760885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d11591-2523-4b04-a8b1-8de533cce9cd None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.763352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 519/1051] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:55.766835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d11591-2523-4b04-a8b1-8de533cce9cd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:55.791609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 533/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:55.792727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.793019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.793300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.812046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:55.813350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:55.828735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:55.879563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d11591-2523-4b04-a8b1-8de533cce9cd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:55.880129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 534/1053] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:55.880961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:55.926185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:55.926979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:55.927275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:55.927556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:55.936812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:55.938653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:55.940173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:55.957512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:55.958430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:55.959778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:55.959778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:55.959778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:55.959778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:55.959778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 520/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:55.960095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:55.984302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfba3c-3161-4d0f-bcb4-c6b6fa38215d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.019458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.019987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.020271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.020544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] PATH_INFO: `/v3/services/image` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.021190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.022579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:56.034622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:56.035611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:56.036792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 535/1055] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 2 08:53:55 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:56.037756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.059771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38757-f7b5-42a6-9410-881792e64ef7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.072254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.094831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.094975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.095207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.095511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.106320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:56.114259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:56.115312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:56.116168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 521/1056] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:56.116941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.142613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137ffe-c4fc-4d25-8755-e3382da4333b None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.158706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.176505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.177173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.177465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.177745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.178471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:56.178782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.180195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.196169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 536/1057] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:56.196169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.214323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9f876-6238-4cb3-98c0-64ceede7fd0b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.247652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.248311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.248595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.248871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.249571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] RBAC: Adding query filter params (name=image) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:56.249880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.251521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.256284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 522/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:56.257051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.291666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e919ee8-3ad0-4a66-8d02-5566690c4791 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.296289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.329178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.329848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.330143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.330419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.331761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:56.332071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.333436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.341427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 537/1059] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:56.342210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.368559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436fea-1a61-4549-9ab1-fed88cef8d1c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.380552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.403564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.404370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.404654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.404929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.412078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.413523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:53:56.427797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:56.429051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:56.430003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 523/1060] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:56.430590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.440969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bce4-e448-409c-816a-6097981c5332 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.475050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.475737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.476025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.476304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.477008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:56.477641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.478704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.483485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 538/1061] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:56.484257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.525641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.531004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b0d17-76e0-4204-a815-516cc2f2ecbb None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.564886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.566248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.566525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.566795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] PATH_INFO: `/v3/users/99962e5672d8426993f386751391b014` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.580210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] RBAC: Authorizing `identity:get_user(user_id=99962e5672d8426993f386751391b014)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.582292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.583983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 524/1062] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/users/99962e5672d8426993f386751391b014 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:56.584571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f279c6c-89de-4ebd-9eeb-a2f9eec71cf1 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.584723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.586107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.621443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.622044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.622332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.622612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.623473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:56.623816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.625788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.648278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 539/1063] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:53:56.648278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.686983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d489a-eee7-4559-817b-e1f601bd6f8d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.720141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.720797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.721082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.721930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.722673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.724072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.740966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d224d1-d811-489e-8f5b-6090c11a0829 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.774138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.774778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.775061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.775372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:56.802029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.819549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 525/1064] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:53:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:53:56.820362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.835616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:56.857212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:56.858703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:56.954621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaeb9d-b55f-40f3-9f32-5bcd4183ee88 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:56.976780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 540/1065] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:53:56.978311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:56.996362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:56.997176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:56.997467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:56.997747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.010005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.011556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:57.030482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:57.031661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:57.032737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:57.032737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:57.032737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:57.032737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:57.032737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 526/1066] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:53:57.038128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:57.051433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:57.099628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87914ff-0cb4-4301-b048-e1a91c58fda5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:57.106358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:57.137310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:57.138289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:57.138645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:57.139059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.140236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] RBAC: Authorizing `identity:get_project(project_id=9815957acf0144f296c2358777b0e1bc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.141694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.143562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 541/1067] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:53:56 2022] GET /identity/v3/projects/9815957acf0144f296c2358777b0e1bc => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:57.149365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:57.153154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d5503-d307-471e-a971-ebb156d59535 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:57.190253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:57.190850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:57.191137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:57.191439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.192160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:57.192471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.194033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.207802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 527/1068] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:57.213033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:57.261092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487a4ed-9812-45f8-98ba-345b00ba829a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:57.288812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:57.298404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:57.299070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:57.299455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:57.299776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.300614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=9815957acf0144f296c2358777b0e1bc, user.id=99962e5672d8426993f386751391b014) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:57.300928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.302362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.308084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 542/1069] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:53:57 2022] GET /identity/v3/role_assignments?user.id=99962e5672d8426993f386751391b014&scope.project.id=9815957acf0144f296c2358777b0e1bc&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:57.323916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a527-d0fe-4522-a621-aee049c4cc87 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:57.345196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:57.365587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:57.366520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:57.366878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:57.367229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.376035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.378777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:53:57.394608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:57.395817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:53:57.397041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:57.402475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 528/1070] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:57.403393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:57.515146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e839e-68ac-4f5a-9bcb-d2dc22350302 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:57.548779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:57.549971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:57.550288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:57.550535 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.551365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:57.551676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.553167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc113b54-2d4e-4a79-86c9-45ef4f32fd77 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.565972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 543/1071] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:57.571677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:57.673727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175f032-b290-4420-99bd-1004e01cb5ea None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:57.708542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412507fe-6678-4e87-97dd-f24879d039fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:57.709434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412507fe-6678-4e87-97dd-f24879d039fc None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:57.709715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412507fe-6678-4e87-97dd-f24879d039fc None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:57.709986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412507fe-6678-4e87-97dd-f24879d039fc None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/7d7ba842465543478b83e1bf3c018223/roles/c463252a8786458197059539c3e71d63` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:57.712202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412507fe-6678-4e87-97dd-f24879d039fc None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=7d7ba842465543478b83e1bf3c018223, role_id=c463252a8786458197059539c3e71d63)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:57.713719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412507fe-6678-4e87-97dd-f24879d039fc None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:57.804455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 529/1072] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:53:57 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/7d7ba842465543478b83e1bf3c018223/roles/c463252a8786458197059539c3e71d63 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:53:59.110442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41f24-99cc-4065-9275-ce87e025a1d1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.110958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41f24-99cc-4065-9275-ce87e025a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.111059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41f24-99cc-4065-9275-ce87e025a1d1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.115272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 544/1073] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:53:59.117735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e0b1-a8d1-440b-8411-c25cd108fe24 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.118153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e0b1-a8d1-440b-8411-c25cd108fe24 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.118313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e0b1-a8d1-440b-8411-c25cd108fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.135156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6f35e0b1-a8d1-440b-8411-c25cd108fe24 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:59.136403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6f35e0b1-a8d1-440b-8411-c25cd108fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:59.167823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:59.207341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 530/1074] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:53:59.229832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41f24-99cc-4065-9275-ce87e025a1d1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:59.285918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:59.333849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41f24-99cc-4065-9275-ce87e025a1d1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:59.368541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:59.369199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.369483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.369758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.436285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:59.437827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:59.488642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:59.534791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8bfd-ee9a-47b1-a403-5b23db1f2706 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.535086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8bfd-ee9a-47b1-a403-5b23db1f2706 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.535398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd8bfd-ee9a-47b1-a403-5b23db1f2706 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.536771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 531/1075] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:53:59.538637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 545/1076] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:53:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 08:53:59.541997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.542287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.542566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.544406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:59.560760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:53:59.561963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:53:59.633638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 532/1077] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:53:59.652853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef75e2-b0b8-4e67-84d2-2cd45c4f7c11 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:59.655978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:59.689509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:59.690904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.691187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.691493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.702131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:59.703687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:53:59.723152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:59.724299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:59.725200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:53:59.725200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:53:59.725200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:53:59.725200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:53:59.725200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 546/1078] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:59.730586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:59.734439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:59.761348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:53:59.764781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc25da-1e9a-4efe-baf6-ce2692635ac3 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:59.800591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:59.801394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.801681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.802018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.814145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:53:59.823325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:53:59.824268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:53:59.825130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 533/1079] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:53:59.830210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:53:59.841962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73757aae-5a4a-47e8-8988-2a5b8046c6e8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:59.879486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:59.880153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.880440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.880717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.881501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:59.881813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:59.883256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:59.894875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 547/1080] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:53:59.946420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9833-f9fd-4381-84df-41e13b39cd92 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:53:59.983654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:53:59.984340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:53:59.984621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:53:59.984893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:53:59.985649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:53:59.985953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:53:59.987908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6b69c-5dcf-4cd2-8cd6-426cd72c6478 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:53:59.999424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 534/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:53:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:00.004708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.059819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a871aa-e775-41d8-88c4-89ce3e23a000 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.060128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a871aa-e775-41d8-88c4-89ce3e23a000 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.060302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a871aa-e775-41d8-88c4-89ce3e23a000 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.061716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 535/1082] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:54:00.067457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.067745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.068019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.076833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.085336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:00.086528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:00.105413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.120145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f6c2b-760e-4c37-b42d-c6728442710a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.158548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.162179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.162179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.162179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] PATH_INFO: `/v3/users/99962e5672d8426993f386751391b014` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.162179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] RBAC: Authorizing `identity:get_user(user_id=99962e5672d8426993f386751391b014)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:00.163054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:00.165052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 548/1083] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/users/99962e5672d8426993f386751391b014 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:00.170460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.171140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 536/1084] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:54:00.195570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.278241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea91c-1201-4bb2-80b4-7c58dfa85896 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.301838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddbf87-ee1b-42cc-9307-a3cdffa3fab7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.305804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.310708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.311608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.311890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.312161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.313350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=9815957acf0144f296c2358777b0e1bc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:00.315340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:00.327333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 549/1085] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/projects/9815957acf0144f296c2358777b0e1bc => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:00.327333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.337212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.338027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.338312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.338590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.349065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:00.357217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:00.358332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:00.359190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 537/1086] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:54:00.364196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.376543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.422037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5960-e2a8-43b7-84c4-1a55ed6c5ec4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.455788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.456671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.456960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.457237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc/users/99962e5672d8426993f386751391b014/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.459214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] RBAC: Authorizing `identity:create_grant(project_id=9815957acf0144f296c2358777b0e1bc, user_id=99962e5672d8426993f386751391b014, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:00.460664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:00.463068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3eef-7b07-40f7-a393-5c05a74bc95a None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.496015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.496684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.496971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.497252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.497993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:00.498305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:00.499704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:00.508332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 538/1087] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:00.514000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.569474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 550/1088] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:54:00 2022] PUT /identity/v3/projects/9815957acf0144f296c2358777b0e1bc/users/99962e5672d8426993f386751391b014/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:54:00.584836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.620403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fabd10-ac10-44e4-8d17-4494dc5320f8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.658359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.659211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.659525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.659802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.672510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:00.674072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:54:00.693742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:00.695018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:00.696193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:54:00.696193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:54:00.696193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:54:00.696193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:00.696193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 539/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:54:00.701073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.765168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.806479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6ffd-9c50-43f9-87b6-39c55249959f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.839700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.840297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.840583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.840862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:00.841591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:00.841902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:00.843320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:00.855450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 551/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:00.860894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:00.960645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4095256-54bc-47d5-9782-6271b349d6e7 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:00.983512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:00.994457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:00.996642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:00.996642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:00.996642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:01.003516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:01.004967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:54:01.018739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:01.019943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:01.020921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 540/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 2 08:54:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:54:01.025873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:01.123104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a82f-f29c-4834-aff7-10458c0db73e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:01.142821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:01.156788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:01.157538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:01.157825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:01.158105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:01.159524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:01.159837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:01.161267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:01.178294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 552/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 2 08:54:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:01.183793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:01.282347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409a1f-7d71-4e67-8d21-616d9b847019 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:01.315419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:01.316073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:01.316362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:01.316640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:01.370315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:01.385804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:01.387190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:01.483597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 541/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:01.489317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:01.587104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc177c-8eaf-4c96-96ff-430929c5b864 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:01.619489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:01.620329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:01.620612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:01.620911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:01.631512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:01.632972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:54:01.650680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:01.651850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:01.652744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:54:01.652744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:54:01.652744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:54:01.652744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:54:01.652744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 553/1094] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:01.657362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:01.741182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:01.756822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c6b5-9509-4e8c-8845-96a418216526 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:01.791201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:01.791877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:01.792165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:01.792439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:01.793148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:01.793450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:01.794822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:01.805949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 542/1095] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:01.811498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:01.841881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:01.909279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81a028-9a54-4a68-b48f-5bcdb40e2c15 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:01.973251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:01.973251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:01.973251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:01.973251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:01.974133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:01.974810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:54:01.975750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 554/1096] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:01.979521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:02.088321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fc970-979f-4ffc-ac0f-d7ae1419501d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:02.120878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:02.121537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:02.121819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:02.122093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:02.122867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:02.123172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:02.124611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc9d48-5834-4f16-b7a0-fecf614bf7b5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:02.137161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 543/1097] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:02.143139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:02.230864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:02.240293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970f821-e0e9-43c3-9ce4-eb3cd4c62f7f None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:02.273412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:02.274063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:02.274347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:02.274624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:02.275483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] RBAC: Adding query filter params (role.id=c463252a8786458197059539c3e71d63, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=7d7ba842465543478b83e1bf3c018223) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:02.275798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:02.277226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c9e1c-7579-442a-9c7b-43b1a0a57739 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:02.283142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 555/1098] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:02 2022] GET /identity/v3/role_assignments?user.id=7d7ba842465543478b83e1bf3c018223&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=c463252a8786458197059539c3e71d63 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:02.810187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd4680-6d24-4240-8537-ef800f44e015 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:02.810734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd4680-6d24-4240-8537-ef800f44e015 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:02.810734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd4680-6d24-4240-8537-ef800f44e015 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:02.812155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 544/1099] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:02.817536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:02.817833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:02.818125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:02.835522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:02.836738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:02.903733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 556/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:02.929294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd4680-6d24-4240-8537-ef800f44e015 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:02.933925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:03.034260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd4680-6d24-4240-8537-ef800f44e015 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:03.068866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:03.069591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:03.069882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:03.070163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:03.080381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:03.088622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:03.089590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:03.090760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 545/1101] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:03.095904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:03.181128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:03.196665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b784e4-db3d-4533-8de1-02f6d4149f20 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:03.230099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:03.230767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:03.231051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:03.231359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:03.232134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:03.232442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:03.233814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:03.241732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 557/1102] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:03.247479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:03.308181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:03.345585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f3ba-eeef-4960-bf1d-e1f65ecdf698 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:03.380704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:03.381564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:03.381851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:03.382132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] PATH_INFO: `/v3/users/99962e5672d8426993f386751391b014` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:03.383342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] RBAC: Authorizing `identity:get_user(user_id=99962e5672d8426993f386751391b014)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:03.384855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:03.386464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 546/1103] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:03 2022] GET /identity/v3/users/99962e5672d8426993f386751391b014 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:03.392207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:03.490550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b10ed8-4fca-461f-b925-3e77ddf7d0a3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:03.523466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:03.524106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:03.524390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:03.524666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:03.539130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:03.589980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:03.591460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:03.684808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 558/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:03.691247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:03.787922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607e55-371f-4c59-8657-01d103148df0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:03.815926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:03.820543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b92dd5-5255-42d8-af49-2d8546daf82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:03.821391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b92dd5-5255-42d8-af49-2d8546daf82e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:03.821670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b92dd5-5255-42d8-af49-2d8546daf82e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:03.821942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b92dd5-5255-42d8-af49-2d8546daf82e None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:03.823107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b92dd5-5255-42d8-af49-2d8546daf82e None admin] RBAC: Authorizing `identity:get_project(project_id=9815957acf0144f296c2358777b0e1bc)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:03.824566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b92dd5-5255-42d8-af49-2d8546daf82e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:03.826221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 547/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:03 2022] GET /identity/v3/projects/9815957acf0144f296c2358777b0e1bc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:03.833043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:03.878703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:03.929147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aa4b5-7f15-46dc-b88a-bb9ca0fa4d11 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:03.961129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:03.961717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:03.961998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:03.962270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:03.963089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=9815957acf0144f296c2358777b0e1bc, user.id=99962e5672d8426993f386751391b014) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:03.963553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:03.964963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d7eac-6539-4bbe-a2cb-638ce4f7c0e5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:03.970577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 559/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:03 2022] GET /identity/v3/role_assignments?user.id=99962e5672d8426993f386751391b014&scope.project.id=9815957acf0144f296c2358777b0e1bc&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:06.193512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec33a2-56dc-4d6d-b751-26d6433ead58 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:06.194023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec33a2-56dc-4d6d-b751-26d6433ead58 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:06.194023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec33a2-56dc-4d6d-b751-26d6433ead58 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:06.195385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 548/1107] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:06.200627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:06.200991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:06.201186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:06.217492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:06.218665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:06.282876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 560/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:06.308300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec33a2-56dc-4d6d-b751-26d6433ead58 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:06.411023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec33a2-56dc-4d6d-b751-26d6433ead58 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:06.442926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1caf9-ba7f-438c-b27f-b78197590dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:06.443779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1caf9-ba7f-438c-b27f-b78197590dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:06.444014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1caf9-ba7f-438c-b27f-b78197590dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:06.444287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1caf9-ba7f-438c-b27f-b78197590dc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:06.445443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1caf9-ba7f-438c-b27f-b78197590dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:06.446878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1caf9-ba7f-438c-b27f-b78197590dc9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:06.448489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 549/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:06.454286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:06.494605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:06.550471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519452-fa31-4300-bce0-2eecdb61a143 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:06.582956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0b2b-9fb2-4b9e-b2e5-7f8b29113c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:06.583655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b2b-9fb2-4b9e-b2e5-7f8b29113c0a None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:06.583942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b2b-9fb2-4b9e-b2e5-7f8b29113c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:06.584220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0b2b-9fb2-4b9e-b2e5-7f8b29113c0a None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:06.584919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b2b-9fb2-4b9e-b2e5-7f8b29113c0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:06.586341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0b2b-9fb2-4b9e-b2e5-7f8b29113c0a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:06.688055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 561/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:54:06 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:54:08.969994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4102-fa52-4de6-a042-2445460d5f56 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:08.970480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4102-fa52-4de6-a042-2445460d5f56 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:08.970584 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4102-fa52-4de6-a042-2445460d5f56 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:08.972482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 550/1111] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:08.977668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:08.978071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:08.978222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:08.994630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:08.995838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:09.061168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 562/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:09.086032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4102-fa52-4de6-a042-2445460d5f56 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:09.152508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:09.184866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4102-fa52-4de6-a042-2445460d5f56 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:09.217617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:09.218455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:09.218737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:09.219014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] PATH_INFO: `/v3/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:09.220497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] RBAC: Authorizing `identity:get_role(role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:09.221902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:09.223261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 551/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:09 2022] GET /identity/v3/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:09.228857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:09.255277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:09.325255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155429-0b9b-4af3-9477-9da80e77193c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:09.357922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:09.358773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:09.359056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:09.359359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] PATH_INFO: `/v3/users/be112c1ca0c244a4918dc624037be8a3` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:09.373316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] RBAC: Authorizing `identity:get_user(user_id=be112c1ca0c244a4918dc624037be8a3)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:09.374968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:09.377420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 563/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:09 2022] GET /identity/v3/users/be112c1ca0c244a4918dc624037be8a3 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:09.383179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:09.480469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce71b0-bec1-44a8-87aa-8e30b40f1db5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:09.513805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:09.514447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:09.514735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:09.515014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:09.518483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:09.580271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:09.581712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:09.677751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 552/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 08:54:09.683549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:09.769974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:09.785471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3be32-7454-4513-a4b9-ec00e82a3583 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:09.818685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2963a-177f-4811-a0ea-550bf13dc3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:09.819640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2963a-177f-4811-a0ea-550bf13dc3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:09.819928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2963a-177f-4811-a0ea-550bf13dc3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:09.820205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2963a-177f-4811-a0ea-550bf13dc3c8 None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:09.821371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2963a-177f-4811-a0ea-550bf13dc3c8 None admin] RBAC: Authorizing `identity:get_project(project_id=9815957acf0144f296c2358777b0e1bc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:09.822798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2963a-177f-4811-a0ea-550bf13dc3c8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:09.824491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 564/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:09 2022] GET /identity/v3/projects/9815957acf0144f296c2358777b0e1bc => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:09.830449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:09.864673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:09.927677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccf541-ad5a-4553-a6f2-117ff2971303 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:09.960437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:09.961090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:09.961375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:09.961653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:09.962478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] RBAC: Adding query filter params (role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=9815957acf0144f296c2358777b0e1bc, user.id=be112c1ca0c244a4918dc624037be8a3) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:09.962789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:09.964248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2676a6-f13b-4055-995d-fdac301eda9a None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:09.969573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 553/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:09 2022] GET /identity/v3/role_assignments?user.id=be112c1ca0c244a4918dc624037be8a3&scope.project.id=9815957acf0144f296c2358777b0e1bc&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:12.157764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe173-355b-413f-9fd8-a7d35f18f7fb None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:12.158314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe173-355b-413f-9fd8-a7d35f18f7fb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:12.158314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efe173-355b-413f-9fd8-a7d35f18f7fb None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:12.159729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 565/1118] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:12.164804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:12.165229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:12.165360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:12.181581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:12.182697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:12.246879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 554/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:12.269990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efe173-355b-413f-9fd8-a7d35f18f7fb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:12.369243 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efe173-355b-413f-9fd8-a7d35f18f7fb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:12.402463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:12.403330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:12.403613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:12.403887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] PATH_INFO: `/v3/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:12.405349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] RBAC: Authorizing `identity:get_role(role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:12.406713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:12.408098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 566/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:12 2022] GET /identity/v3/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:12.413722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:12.443262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:12.510281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e6b45-872e-4eb0-9fa7-b34a553c5d56 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:12.542719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:12.543598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:12.543879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:12.544151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] PATH_INFO: `/v3/users/be112c1ca0c244a4918dc624037be8a3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:12.545312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] RBAC: Authorizing `identity:get_user(user_id=be112c1ca0c244a4918dc624037be8a3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:12.546725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:12.548320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 555/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:12 2022] GET /identity/v3/users/be112c1ca0c244a4918dc624037be8a3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:12.554370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:12.575870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:12.650286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40b406-3759-4e08-ab71-622e6ee46ab0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:12.682585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bacf-0f1f-43cc-821f-24bd6bee9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:12.683455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bacf-0f1f-43cc-821f-24bd6bee9aba None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:12.683742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bacf-0f1f-43cc-821f-24bd6bee9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:12.684021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bacf-0f1f-43cc-821f-24bd6bee9aba None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:12.685190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441bacf-0f1f-43cc-821f-24bd6bee9aba None admin] RBAC: Authorizing `identity:get_project(project_id=9815957acf0144f296c2358777b0e1bc)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:12.686613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441bacf-0f1f-43cc-821f-24bd6bee9aba None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:12.688293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 567/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:12 2022] GET /identity/v3/projects/9815957acf0144f296c2358777b0e1bc => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:12.694602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:12.788713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:12.792438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31bc2-4df0-4915-a0b5-ed147872ac34 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:12.825049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02968b09-d9d8-41fb-9250-9955d1c86ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:12.825944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968b09-d9d8-41fb-9250-9955d1c86ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:12.826386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968b09-d9d8-41fb-9250-9955d1c86ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:12.826967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968b09-d9d8-41fb-9250-9955d1c86ae3 None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc/users/be112c1ca0c244a4918dc624037be8a3/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:12.829162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02968b09-d9d8-41fb-9250-9955d1c86ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9815957acf0144f296c2358777b0e1bc, user_id=be112c1ca0c244a4918dc624037be8a3, role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:12.830616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02968b09-d9d8-41fb-9250-9955d1c86ae3 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:12.928891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 556/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:54:12 2022] PUT /identity/v3/projects/9815957acf0144f296c2358777b0e1bc/users/be112c1ca0c244a4918dc624037be8a3/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:54:15.129038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a16e-1b71-4e32-934e-9380f45280e4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:15.129579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a16e-1b71-4e32-934e-9380f45280e4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:15.129579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a16e-1b71-4e32-934e-9380f45280e4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:15.130963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 568/1124] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:15.136344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:15.136740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:15.136969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:15.154867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:15.156106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:15.221232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 557/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:15.245500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451a16e-1b71-4e32-934e-9380f45280e4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:15.330477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:15.342708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451a16e-1b71-4e32-934e-9380f45280e4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:15.376294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:15.377331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:15.377618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:15.377895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] PATH_INFO: `/v3/roles/56749b3da4384fbe86c2e17aed5a6854` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:15.379431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] RBAC: Authorizing `identity:get_role(role_id=56749b3da4384fbe86c2e17aed5a6854)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:15.380809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:15.382165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 569/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:15 2022] GET /identity/v3/roles/56749b3da4384fbe86c2e17aed5a6854 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:15.388141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:15.473340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:15.484546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c755220-9ff2-4e94-96f6-a132b9246a36 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:15.518136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:15.518996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:15.519305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:15.519581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] PATH_INFO: `/v3/users/be112c1ca0c244a4918dc624037be8a3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:15.520759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] RBAC: Authorizing `identity:get_user(user_id=be112c1ca0c244a4918dc624037be8a3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:15.522187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:15.523809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 558/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:15 2022] GET /identity/v3/users/be112c1ca0c244a4918dc624037be8a3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:15.529488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:15.624414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ca1f2-af57-4901-a486-aad3ac510b70 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:15.657916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:15.659089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:15.659408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:15.659682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:15.682813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:15.724011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:15.725388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:15.818771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 570/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:15.824498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:15.920206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e2cc-24ea-41a8-8346-190a49dd6b06 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:15.956277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5caa1-7b32-48bf-acd2-fed57b5f03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:15.957137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5caa1-7b32-48bf-acd2-fed57b5f03f8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:15.957419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5caa1-7b32-48bf-acd2-fed57b5f03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:15.957691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5caa1-7b32-48bf-acd2-fed57b5f03f8 None admin] PATH_INFO: `/v3/projects/9815957acf0144f296c2358777b0e1bc` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:15.958860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5caa1-7b32-48bf-acd2-fed57b5f03f8 None admin] RBAC: Authorizing `identity:get_project(project_id=9815957acf0144f296c2358777b0e1bc)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:15.960332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5caa1-7b32-48bf-acd2-fed57b5f03f8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:15.962007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 559/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:15 2022] GET /identity/v3/projects/9815957acf0144f296c2358777b0e1bc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:15.968233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:16.023053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:16.064799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ae7c9-053a-47af-a4ba-8dc22de3e9ac None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:16.098375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:16.099020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:16.099334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:16.099615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:16.100437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] RBAC: Adding query filter params (role.id=56749b3da4384fbe86c2e17aed5a6854, scope.project.id=9815957acf0144f296c2358777b0e1bc, user.id=be112c1ca0c244a4918dc624037be8a3) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:16.100750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:16.102170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dca9e0-2259-44cd-b307-3b7a92a899e0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:16.107894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 571/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:15 2022] GET /identity/v3/role_assignments?user.id=be112c1ca0c244a4918dc624037be8a3&scope.project.id=9815957acf0144f296c2358777b0e1bc&role.id=56749b3da4384fbe86c2e17aed5a6854 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:18.331144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd07c6-6fab-4605-a61b-9993b605b9d2 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:18.331686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd07c6-6fab-4605-a61b-9993b605b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:18.331686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd07c6-6fab-4605-a61b-9993b605b9d2 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:18.332995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 560/1131] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:18.338738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:18.339152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:18.339307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:18.355549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:18.356724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:18.419813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 572/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:18.443708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd07c6-6fab-4605-a61b-9993b605b9d2 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:18.468205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:18.541603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd07c6-6fab-4605-a61b-9993b605b9d2 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:18.574859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06aac-b3c2-4934-89b2-0f4c65606f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:18.575659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06aac-b3c2-4934-89b2-0f4c65606f56 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:18.575948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06aac-b3c2-4934-89b2-0f4c65606f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:18.576226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06aac-b3c2-4934-89b2-0f4c65606f56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:18.577392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06aac-b3c2-4934-89b2-0f4c65606f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:18.578818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06aac-b3c2-4934-89b2-0f4c65606f56 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:18.580456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 561/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:54:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:18.586064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:18.633918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:18.680914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9b356-ec22-4023-8ab8-f5c28e6797c4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:18.713059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122da21-9612-411c-ac9d-bd08348cccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:18.713704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122da21-9612-411c-ac9d-bd08348cccaa None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:18.713986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122da21-9612-411c-ac9d-bd08348cccaa None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:18.714262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122da21-9612-411c-ac9d-bd08348cccaa None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:18.714953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122da21-9612-411c-ac9d-bd08348cccaa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:18.716403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122da21-9612-411c-ac9d-bd08348cccaa None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:18.797183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 573/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:54:18 2022] POST /identity/v3/projects => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:54:21.049092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb3c58-1511-4957-89a8-063ea88cd07f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:21.049605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb3c58-1511-4957-89a8-063ea88cd07f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:21.049726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb3c58-1511-4957-89a8-063ea88cd07f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:21.051036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 562/1135] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:21.056321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:21.056733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:21.056883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:21.073776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:21.074935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:21.139931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 574/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:21.164846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb3c58-1511-4957-89a8-063ea88cd07f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:21.254343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:21.263447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb3c58-1511-4957-89a8-063ea88cd07f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:21.297390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257569b-a4bf-465f-9edc-7c2ba7ea71aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:21.298171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257569b-a4bf-465f-9edc-7c2ba7ea71aa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:21.298459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257569b-a4bf-465f-9edc-7c2ba7ea71aa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:21.298736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257569b-a4bf-465f-9edc-7c2ba7ea71aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:21.299930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257569b-a4bf-465f-9edc-7c2ba7ea71aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:21.301380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257569b-a4bf-465f-9edc-7c2ba7ea71aa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:21.302967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 563/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:21.308694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:21.338998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:21.412632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ead63-577f-4d3e-8b30-db94dc516a18 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:21.447528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ce591-aacb-49af-bb1a-8e0ffb219976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:21.448195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ce591-aacb-49af-bb1a-8e0ffb219976 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:21.448480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ce591-aacb-49af-bb1a-8e0ffb219976 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:21.448757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ce591-aacb-49af-bb1a-8e0ffb219976 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:21.449456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ce591-aacb-49af-bb1a-8e0ffb219976 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:21.450891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ce591-aacb-49af-bb1a-8e0ffb219976 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:21.521903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 575/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:54:21 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:54:23.809777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518444a3-4546-419e-8228-281ee324065c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:23.810303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518444a3-4546-419e-8228-281ee324065c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:23.810303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518444a3-4546-419e-8228-281ee324065c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:23.811703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 564/1139] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:23.817673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:23.818051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:23.818232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:23.834563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:23.835847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:23.900690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 576/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:54:23.924687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518444a3-4546-419e-8228-281ee324065c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:24.024412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518444a3-4546-419e-8228-281ee324065c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:24.057709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:24.058494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:24.058780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:24.059057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:24.068998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:24.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:24.077649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:24.078714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 565/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:24.083780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:24.102160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:24.180196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61e04-d060-4228-a1b8-ca6e1774c027 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:24.212253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:24.212911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:24.213201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:24.213482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:24.214224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:24.214531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:24.215933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:24.224254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 577/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:24.229838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:24.252330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:24.327634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff509c5c-5dbe-4e1e-a796-c8bfe4378e3d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:24.359920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:24.360777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:24.361060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:24.361334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] PATH_INFO: `/v3/users/8d59b3f3aa80420bb0a0a3170fadde9d` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:24.374441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] RBAC: Authorizing `identity:get_user(user_id=8d59b3f3aa80420bb0a0a3170fadde9d)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:24.375914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:24.377824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 566/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:24 2022] GET /identity/v3/users/8d59b3f3aa80420bb0a0a3170fadde9d => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:24.383786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:24.461924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:24.479970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fb43d-b330-49a7-8530-abb913f27f21 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:24.511970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:24.512599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:24.512883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:24.513160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:24.576996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:24.578483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:24.653457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:24.672298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 578/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:24.678403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:24.754516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:24.775555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77300-f109-4eca-a0b5-206c9292442d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:24.809188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ddad8-b324-4a6b-81c3-bbb41b974e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:24.810037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ddad8-b324-4a6b-81c3-bbb41b974e64 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:24.810568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ddad8-b324-4a6b-81c3-bbb41b974e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:24.810568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ddad8-b324-4a6b-81c3-bbb41b974e64 None admin] PATH_INFO: `/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:24.811758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ddad8-b324-4a6b-81c3-bbb41b974e64 None admin] RBAC: Authorizing `identity:get_project(project_id=e38b75d6f09a435d9474d9dcd6b649e0)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:24.813192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ddad8-b324-4a6b-81c3-bbb41b974e64 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:24.815378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 567/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:24 2022] GET /identity/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:24.821279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:24.915859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169139-8fc8-4761-bb06-1868f68e0ec7 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:24.949396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:24.950047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:24.950332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:24.950611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:24.951473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=e38b75d6f09a435d9474d9dcd6b649e0, user.id=8d59b3f3aa80420bb0a0a3170fadde9d) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:24.951786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:24.953218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6bc0-783f-48a4-b139-1cf105da9ed6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:24.959112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 579/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:24 2022] GET /identity/v3/role_assignments?user.id=8d59b3f3aa80420bb0a0a3170fadde9d&scope.project.id=e38b75d6f09a435d9474d9dcd6b649e0&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:27.147693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b276-7c85-4a2c-9c1f-963bb408329e None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.148213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b276-7c85-4a2c-9c1f-963bb408329e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.148322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b276-7c85-4a2c-9c1f-963bb408329e None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.149619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 568/1147] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:27.154936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.155374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.155520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.172374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:27.173551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:27.211973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:27.238595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 580/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:27.261578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b276-7c85-4a2c-9c1f-963bb408329e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:27.363470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b276-7c85-4a2c-9c1f-963bb408329e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:27.396926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:27.397712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.397998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.398276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.408036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:27.415658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:27.416747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:27.418008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 569/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:54:27.422896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:27.519261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067cb1e-4980-44cc-b146-0fe46d7b34e0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:27.551543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:27.552204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.552487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.552762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.553500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:27.553814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:27.555182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:27.562946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 581/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:27.569268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:27.578284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:27.665305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d87455-9a81-4081-80d8-a13f4d686bc8 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:27.698060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:27.698910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.699185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.699481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] PATH_INFO: `/v3/users/8d59b3f3aa80420bb0a0a3170fadde9d` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.700643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] RBAC: Authorizing `identity:get_user(user_id=8d59b3f3aa80420bb0a0a3170fadde9d)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:27.702074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:27.703740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 570/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:27 2022] GET /identity/v3/users/8d59b3f3aa80420bb0a0a3170fadde9d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:27.709367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:27.743909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:27.806315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5dcab-53e0-4b56-a3f6-2641dee500ac None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:27.837734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fa8e6-f5f2-443a-b3d5-7163d09b7d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:27.838584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fa8e6-f5f2-443a-b3d5-7163d09b7d95 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.838865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fa8e6-f5f2-443a-b3d5-7163d09b7d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.839138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fa8e6-f5f2-443a-b3d5-7163d09b7d95 None admin] PATH_INFO: `/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.840340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fa8e6-f5f2-443a-b3d5-7163d09b7d95 None admin] RBAC: Authorizing `identity:get_project(project_id=e38b75d6f09a435d9474d9dcd6b649e0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:27.841771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fa8e6-f5f2-443a-b3d5-7163d09b7d95 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:27.843461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 582/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:27 2022] GET /identity/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:27.849718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:27.922747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:27.947385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3d1c0-0d6e-426b-b541-df91b5a64f1f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:27.980167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90015815-efc4-48ed-8cea-1c503806ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:27.981034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015815-efc4-48ed-8cea-1c503806ef56 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:27.981314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015815-efc4-48ed-8cea-1c503806ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:27.981587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015815-efc4-48ed-8cea-1c503806ef56 None admin] PATH_INFO: `/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0/users/8d59b3f3aa80420bb0a0a3170fadde9d/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:27.983548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90015815-efc4-48ed-8cea-1c503806ef56 None admin] RBAC: Authorizing `identity:create_grant(project_id=e38b75d6f09a435d9474d9dcd6b649e0, user_id=8d59b3f3aa80420bb0a0a3170fadde9d, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:27.984988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90015815-efc4-48ed-8cea-1c503806ef56 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:28.082105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 571/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:54:27 2022] PUT /identity/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0/users/8d59b3f3aa80420bb0a0a3170fadde9d/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:54:30.280912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbea9d-2abf-4c0e-88a3-88d09013970a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:30.281410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbea9d-2abf-4c0e-88a3-88d09013970a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:30.281410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbea9d-2abf-4c0e-88a3-88d09013970a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:30.282748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 583/1154] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:30.288611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:30.289018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:30.289316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:30.306266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:30.307479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:30.371081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 572/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:30.395061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbea9d-2abf-4c0e-88a3-88d09013970a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:30.492478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbea9d-2abf-4c0e-88a3-88d09013970a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:30.494667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:30.524863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:30.525632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:30.525915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:30.526227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:30.537158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:30.544828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:30.545949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:54:30.547031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 584/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:30.552029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:30.612104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:30.648858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297172-b8b8-4ed0-86c2-9fd17e21ff03 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:30.681223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:30.681867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:30.682149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:30.682421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:30.683151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:30.683480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:30.684839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:30.693064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 573/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:30.698790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:30.797213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe942888-a556-4af4-bfdf-91b3abbf90bb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:30.830802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:30.831700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:30.832003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:30.832261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] PATH_INFO: `/v3/users/8d59b3f3aa80420bb0a0a3170fadde9d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:30.833454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] RBAC: Authorizing `identity:get_user(user_id=8d59b3f3aa80420bb0a0a3170fadde9d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:30.834907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:30.836567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 585/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:30 2022] GET /identity/v3/users/8d59b3f3aa80420bb0a0a3170fadde9d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:30.842230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:30.940786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353f738-df6c-4dc5-afbd-c722573e4c2c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:30.965230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:30.973488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:30.974122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:30.974403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:30.978040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:31.039752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:31.041176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:31.134249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 574/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:31.140025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:31.171433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:31.236090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f539546-86bd-42bb-a8b8-77cec6fe5c89 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:31.268974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59623dab-91d8-410c-95c8-ab9814235595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:31.269821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59623dab-91d8-410c-95c8-ab9814235595 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:31.270107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59623dab-91d8-410c-95c8-ab9814235595 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:31.270384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59623dab-91d8-410c-95c8-ab9814235595 None admin] PATH_INFO: `/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:31.271579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59623dab-91d8-410c-95c8-ab9814235595 None admin] RBAC: Authorizing `identity:get_project(project_id=e38b75d6f09a435d9474d9dcd6b649e0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:31.273000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59623dab-91d8-410c-95c8-ab9814235595 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:31.274680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 586/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:31 2022] GET /identity/v3/projects/e38b75d6f09a435d9474d9dcd6b649e0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:31.280650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:31.307579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:31.386202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a2de6-3cb3-4e86-b8c1-313f68bce4db None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:31.420667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:31.421323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:31.421607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:31.421887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:31.422711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=e38b75d6f09a435d9474d9dcd6b649e0, user.id=8d59b3f3aa80420bb0a0a3170fadde9d) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:31.423028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:31.425025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c2f58-73ba-4a88-8a0a-85d44d40c000 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:31.430758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 575/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:31 2022] GET /identity/v3/role_assignments?user.id=8d59b3f3aa80420bb0a0a3170fadde9d&scope.project.id=e38b75d6f09a435d9474d9dcd6b649e0&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:33.674861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ef1a-fc56-4915-8255-7c814bf903a1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:33.675456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ef1a-fc56-4915-8255-7c814bf903a1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:33.675456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ef1a-fc56-4915-8255-7c814bf903a1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:33.676804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 587/1162] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:33.682042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:33.682427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:33.682607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:33.698966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:33.700182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:33.765570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 576/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:33.788062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1ef1a-fc56-4915-8255-7c814bf903a1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:33.883049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:33.886582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1ef1a-fc56-4915-8255-7c814bf903a1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:33.919485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:33.920138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:33.920420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:33.920693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:33.985350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:33.986904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:34.076942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:34.080942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 588/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:34.086870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:34.107436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:34.183191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf54ff-58ad-4d85-b3b5-154b95708c99 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:34.215910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:34.216699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:34.216984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:34.217262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:34.223780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:34.225211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-698cbbb8-3376-47a4-854c-e692c7b006b8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:34.239653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:34.240889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:34.241916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 577/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:54:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:34.246638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:34.343103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d28a8-81f6-433c-bd6c-a556decf044d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:34.375718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:34.376649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:34.377501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:34.377782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:34.378505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:34.378814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:34.380205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce49d80-0a5d-4b23-a797-bd76f9d6d5f8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:34.387141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 589/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 2 08:54:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:36.597473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62eb1a-2d4e-4db0-a101-19798bf0ca8c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:36.598020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62eb1a-2d4e-4db0-a101-19798bf0ca8c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:36.598020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62eb1a-2d4e-4db0-a101-19798bf0ca8c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:36.599425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 578/1167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:36.604830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54edd6-5a60-41c6-8489-827e252121f6 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:36.605257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54edd6-5a60-41c6-8489-827e252121f6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:36.605388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54edd6-5a60-41c6-8489-827e252121f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:36.621766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6f54edd6-5a60-41c6-8489-827e252121f6 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:36.622946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6f54edd6-5a60-41c6-8489-827e252121f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:36.679508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:36.687446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 590/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:54:36.710297 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62eb1a-2d4e-4db0-a101-19798bf0ca8c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:36.794304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:36.814984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62eb1a-2d4e-4db0-a101-19798bf0ca8c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:36.848063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd0fb-6253-4500-b325-50b612c96a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:36.848666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd0fb-6253-4500-b325-50b612c96a06 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:36.848954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd0fb-6253-4500-b325-50b612c96a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:36.849232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd0fb-6253-4500-b325-50b612c96a06 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:36.849983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd0fb-6253-4500-b325-50b612c96a06 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:36.851387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd0fb-6253-4500-b325-50b612c96a06 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:36.901322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 579/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Jun 2 08:54:36 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:54:39.159786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90cd79-705d-47d3-b896-c5eb2c378d44 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:39.160332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90cd79-705d-47d3-b896-c5eb2c378d44 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:39.160332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90cd79-705d-47d3-b896-c5eb2c378d44 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:39.161729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 591/1170] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:39.166841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:39.167367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:39.167478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:39.184738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:39.185868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:39.250845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 580/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:39.274585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90cd79-705d-47d3-b896-c5eb2c378d44 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:39.374190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90cd79-705d-47d3-b896-c5eb2c378d44 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:39.408713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d146d0-40b0-4d1f-8192-93b6f26868c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:39.409562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d146d0-40b0-4d1f-8192-93b6f26868c4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:39.409850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d146d0-40b0-4d1f-8192-93b6f26868c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:39.410127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d146d0-40b0-4d1f-8192-93b6f26868c4 None admin] PATH_INFO: `/v3/domains/b5538d082b444787ae89c13de60d562b` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:39.420292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d146d0-40b0-4d1f-8192-93b6f26868c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b5538d082b444787ae89c13de60d562b)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:39.421745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d146d0-40b0-4d1f-8192-93b6f26868c4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:39.423401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 592/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jun 2 08:54:39 2022] GET /identity/v3/domains/b5538d082b444787ae89c13de60d562b => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:39.429365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:39.498579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:39.528705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3790dcc-317f-4516-be5e-40bf94f92ba6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:39.562636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09558b1-a819-4a11-a0c5-cd070b688c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:39.563322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09558b1-a819-4a11-a0c5-cd070b688c47 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:39.563614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09558b1-a819-4a11-a0c5-cd070b688c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:39.563914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09558b1-a819-4a11-a0c5-cd070b688c47 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:39.564637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09558b1-a819-4a11-a0c5-cd070b688c47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:39.566173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09558b1-a819-4a11-a0c5-cd070b688c47 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:39.643447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 581/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:54:39 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:54:41.879099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00fdd-0cc4-4ef7-a4c0-5a20168b5f21 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:41.879678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00fdd-0cc4-4ef7-a4c0-5a20168b5f21 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:41.879678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00fdd-0cc4-4ef7-a4c0-5a20168b5f21 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:41.881059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 593/1174] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:41.886303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:41.886738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:41.886851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:41.903123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:41.904321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:41.969822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 582/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:41.994539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00fdd-0cc4-4ef7-a4c0-5a20168b5f21 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:42.050228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:42.093005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00fdd-0cc4-4ef7-a4c0-5a20168b5f21 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:42.125445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b15a99-ed83-4fa7-87a0-9b8769b06604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:42.126588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b15a99-ed83-4fa7-87a0-9b8769b06604 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:42.126870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b15a99-ed83-4fa7-87a0-9b8769b06604 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:42.127146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b15a99-ed83-4fa7-87a0-9b8769b06604 None admin] PATH_INFO: `/v3/domains/b5538d082b444787ae89c13de60d562b` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:42.128347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b15a99-ed83-4fa7-87a0-9b8769b06604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b5538d082b444787ae89c13de60d562b)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:42.129823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b15a99-ed83-4fa7-87a0-9b8769b06604 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:42.131381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 594/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jun 2 08:54:41 2022] GET /identity/v3/domains/b5538d082b444787ae89c13de60d562b => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:42.137002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:42.188227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:42.235339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96448-b855-4316-943d-d2fab4f61a3e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:42.269183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab45f8-1d33-4605-b328-b736adf121b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:42.269852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab45f8-1d33-4605-b328-b736adf121b7 None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:42.270143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab45f8-1d33-4605-b328-b736adf121b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:42.270425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab45f8-1d33-4605-b328-b736adf121b7 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:42.271136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab45f8-1d33-4605-b328-b736adf121b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:42.272600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab45f8-1d33-4605-b328-b736adf121b7 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:42.339679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 583/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:54:42 2022] POST /identity/v3/users => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:54:44.690931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706aeed-b886-41d5-98cb-d70d61ab8dfd None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:44.691502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706aeed-b886-41d5-98cb-d70d61ab8dfd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:44.691502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706aeed-b886-41d5-98cb-d70d61ab8dfd None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:44.692887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 595/1178] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:44.698129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:44.698565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:44.698671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:44.714944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:44.716150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:44.779842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 584/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:44.803332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706aeed-b886-41d5-98cb-d70d61ab8dfd None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:44.901262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706aeed-b886-41d5-98cb-d70d61ab8dfd None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:44.922404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:44.934079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:44.934954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:44.935256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:44.935542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:44.946748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:44.954333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:44.955507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:54:44.956401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 596/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:44.961637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:44.999991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:45.059638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8484681-4ae7-4821-8187-3cde5f629fd3 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:45.092142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:45.092820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:45.093090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:45.093371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:45.094123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:45.094435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:45.096348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:45.104184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 585/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:45.109801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:45.206040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196fea0-c29d-4b48-aa75-ea655687a030 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:45.238847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:45.239725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:45.240005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:45.240278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] PATH_INFO: `/v3/users/17d505f037a348dfbb0284aa1e016331` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:45.253438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] RBAC: Authorizing `identity:get_user(user_id=17d505f037a348dfbb0284aa1e016331)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:45.254863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:45.256594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 597/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:45 2022] GET /identity/v3/users/17d505f037a348dfbb0284aa1e016331 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:45.262078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:45.356873 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:45.359746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac70ded-5d78-4993-885b-640736d36861 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:45.393726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:45.394368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:45.394655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:45.394937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:45.464169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:45.465618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:45.560418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:45.564619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 586/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:45.570443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:45.610212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:45.666370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11283f4-c04c-4b1c-8dd5-5839cc043534 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:45.699255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150b5bc-e967-4992-8bb1-f5daa970d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:45.700112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b5bc-e967-4992-8bb1-f5daa970d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:45.700395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b5bc-e967-4992-8bb1-f5daa970d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:45.700672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b5bc-e967-4992-8bb1-f5daa970d9e3 None admin] PATH_INFO: `/v3/projects/af96be02f5f74baaa094a309fe67d98a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:45.701841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150b5bc-e967-4992-8bb1-f5daa970d9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=af96be02f5f74baaa094a309fe67d98a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:45.703310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150b5bc-e967-4992-8bb1-f5daa970d9e3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:45.705006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 598/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:45 2022] GET /identity/v3/projects/af96be02f5f74baaa094a309fe67d98a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:45.711014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:45.807319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd9bc2-7ddc-4d8e-b4aa-313f32aabd97 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:45.839648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:45.840308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:45.840596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:45.840879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:45.841705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=af96be02f5f74baaa094a309fe67d98a, user.id=17d505f037a348dfbb0284aa1e016331) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:45.842020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:45.843488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0076a8-c645-44f2-8c8f-1c53eebe4cb6 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:45.849437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 587/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:45 2022] GET /identity/v3/role_assignments?user.id=17d505f037a348dfbb0284aa1e016331&scope.project.id=af96be02f5f74baaa094a309fe67d98a&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:54:48.033132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24d30-9314-4263-b164-a12a0f28a22d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.033661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24d30-9314-4263-b164-a12a0f28a22d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.033661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24d30-9314-4263-b164-a12a0f28a22d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.035047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 599/1186] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:48.040402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.040810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.040959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.057769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:48.058929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:48.115198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:48.123076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 588/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:54:48.146203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24d30-9314-4263-b164-a12a0f28a22d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:48.243787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24d30-9314-4263-b164-a12a0f28a22d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:48.253666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:48.276739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:48.277506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.277785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.278056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.288743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:48.296343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:48.297447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:54:48.299040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 600/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:48.304128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:48.398593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee3a6-e388-473e-a31a-4b86c2de8c8f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:48.430901 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:48.431574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.431855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.432129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.432858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:48.433161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:48.434518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:48.442325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 589/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:48.447929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:48.544901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01ae1-e778-459b-94e4-dc647ec96572 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:48.576240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:48.577085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.577369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.577645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] PATH_INFO: `/v3/users/17d505f037a348dfbb0284aa1e016331` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.578807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] RBAC: Authorizing `identity:get_user(user_id=17d505f037a348dfbb0284aa1e016331)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:48.580812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:48.582396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 601/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:48 2022] GET /identity/v3/users/17d505f037a348dfbb0284aa1e016331 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:48.588093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:48.643552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:48.686473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e8f76-70f9-4075-852f-b9fc9899d503 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:48.719064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5864-7ca3-4941-9169-f865fd0e7d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:48.720531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5864-7ca3-4941-9169-f865fd0e7d23 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.720814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5864-7ca3-4941-9169-f865fd0e7d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.721089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5864-7ca3-4941-9169-f865fd0e7d23 None admin] PATH_INFO: `/v3/projects/af96be02f5f74baaa094a309fe67d98a` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.722257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5864-7ca3-4941-9169-f865fd0e7d23 None admin] RBAC: Authorizing `identity:get_project(project_id=af96be02f5f74baaa094a309fe67d98a)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:48.723733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5864-7ca3-4941-9169-f865fd0e7d23 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:48.725405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 590/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:48 2022] GET /identity/v3/projects/af96be02f5f74baaa094a309fe67d98a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:48.731221 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:48.765653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:48.828114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2410f-b48c-483c-8bef-50eeab90b6bf None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:48.860058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b956a0-ec92-4b16-9e72-8ea511aabaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:48.860933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b956a0-ec92-4b16-9e72-8ea511aabaf6 None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:48.861216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b956a0-ec92-4b16-9e72-8ea511aabaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:48.861490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b956a0-ec92-4b16-9e72-8ea511aabaf6 None admin] PATH_INFO: `/v3/projects/af96be02f5f74baaa094a309fe67d98a/users/17d505f037a348dfbb0284aa1e016331/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:48.863452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b956a0-ec92-4b16-9e72-8ea511aabaf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=af96be02f5f74baaa094a309fe67d98a, user_id=17d505f037a348dfbb0284aa1e016331, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:48.864879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b956a0-ec92-4b16-9e72-8ea511aabaf6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:48.932237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 602/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:54:48 2022] PUT /identity/v3/projects/af96be02f5f74baaa094a309fe67d98a/users/17d505f037a348dfbb0284aa1e016331/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:54:51.132375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28daaca-e0d2-40cf-9575-3238f0761791 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:51.132891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28daaca-e0d2-40cf-9575-3238f0761791 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:51.133011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28daaca-e0d2-40cf-9575-3238f0761791 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:51.134266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 591/1193] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:54:51.139678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:51.140102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:51.140236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:51.157072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:54:51.158797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:54:51.222176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 603/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:54:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:54:51.245253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28daaca-e0d2-40cf-9575-3238f0761791 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:51.343748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28daaca-e0d2-40cf-9575-3238f0761791 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:51.366117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:51.377080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:51.377855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:51.378133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:51.378402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:51.388609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:54:51.396711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:54:51.397836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:54:51.398889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 592/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:54:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:54:51.403784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:51.429523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:51.499598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8103-6aa8-4d70-8441-af37af9eb765 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:51.536157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:51.536820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:51.537106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:51.537383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:51.538130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:51.538440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:51.539855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:51.547770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 604/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:54:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:51.553479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:51.651972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5695789-8b0b-4317-b417-5dd9cab4326f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:51.686177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:51.687028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:51.687339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:51.687626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] PATH_INFO: `/v3/users/17d505f037a348dfbb0284aa1e016331` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:51.688829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] RBAC: Authorizing `identity:get_user(user_id=17d505f037a348dfbb0284aa1e016331)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:51.690273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:51.691900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 593/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 2 08:54:51 2022] GET /identity/v3/users/17d505f037a348dfbb0284aa1e016331 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:51.697569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:51.783438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:51.794538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b78a-6780-4bce-af02-0810710b12c4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:51.826081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:51.826715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:51.826999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:51.827300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:51.891352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:51.893341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:51.978689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:51.990957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 605/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:54:51.996845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:52.049428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:54:52.095726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2c00c-3e5a-4e09-8431-6f157f9db289 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:52.128854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075812-8351-4988-8819-8ffa66b4bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:52.129716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075812-8351-4988-8819-8ffa66b4bc25 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:52.130004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075812-8351-4988-8819-8ffa66b4bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:52.130281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075812-8351-4988-8819-8ffa66b4bc25 None admin] PATH_INFO: `/v3/projects/af96be02f5f74baaa094a309fe67d98a` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:52.131476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075812-8351-4988-8819-8ffa66b4bc25 None admin] RBAC: Authorizing `identity:get_project(project_id=af96be02f5f74baaa094a309fe67d98a)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:52.132933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075812-8351-4988-8819-8ffa66b4bc25 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:52.134598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 594/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 2 08:54:51 2022] GET /identity/v3/projects/af96be02f5f74baaa094a309fe67d98a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:54:52.140729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:54:52.235110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96878cbd-de4d-45b7-9853-ad778493af4c None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:54:52.268426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:54:52.269070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:54:52.269355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:54:52.269633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:54:52.270451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=af96be02f5f74baaa094a309fe67d98a, user.id=17d505f037a348dfbb0284aa1e016331) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:54:52.270762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:54:52.272215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a82d-09da-4e26-a980-e71fbbb4b4ca None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:54:52.277797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 606/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:54:52 2022] GET /identity/v3/role_assignments?user.id=17d505f037a348dfbb0284aa1e016331&scope.project.id=af96be02f5f74baaa094a309fe67d98a&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:55:02.123979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=40 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:55:02.275334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=74 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:07.328168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e4bc7-b868-46b6-a908-0169bc9369db None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:07.328716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e4bc7-b868-46b6-a908-0169bc9369db None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:07.328716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e4bc7-b868-46b6-a908-0169bc9369db None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:07.330022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 595/1201] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 08:56:07.335261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:07.335699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:07.335823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:07.352216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:07.353385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:07.418675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 607/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:56:07.443218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e4bc7-b868-46b6-a908-0169bc9369db None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:07.544209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e4bc7-b868-46b6-a908-0169bc9369db None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:07.579036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:07.579784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:07.580068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:07.580343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:07.590253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:07.591731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:07.609415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:07.610371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:07.611470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:07.611470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:07.611470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:07.611470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:07.611470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 596/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:07.618035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:07.715347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e997a2-f762-4fba-b167-8f14adc65c23 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:07.743772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:07.750035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:07.750962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:07.751268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:07.751552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:07.752270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:07.752578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:07.753953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2002f8-c6c6-4be9-9ee9-79f797b59d7a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:07.765039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 608/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:07.771069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:07.824105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:07.873237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c5d7-60df-43bb-be57-00ecb8dfb73c None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:07.907238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845af18e-e11e-4cfc-941c-15a71e5a4aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:07.907927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af18e-e11e-4cfc-941c-15a71e5a4aae None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:07.908216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af18e-e11e-4cfc-941c-15a71e5a4aae None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:07.908545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845af18e-e11e-4cfc-941c-15a71e5a4aae None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:07.909251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845af18e-e11e-4cfc-941c-15a71e5a4aae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:07.910677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845af18e-e11e-4cfc-941c-15a71e5a4aae None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:08.005619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 597/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 2 08:56:07 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 08:56:10.284213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eff5f-e673-4db7-a944-fcc8d433961a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:10.284755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eff5f-e673-4db7-a944-fcc8d433961a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:10.284755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eff5f-e673-4db7-a944-fcc8d433961a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:10.286046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 609/1206] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:10.291335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:10.291733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:10.291946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:10.308366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:10.309547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:10.375505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 598/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:56:10.399474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eff5f-e673-4db7-a944-fcc8d433961a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:10.501610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eff5f-e673-4db7-a944-fcc8d433961a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:10.533183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:10.533970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:10.534298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:10.534526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:10.544762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:56:10.552934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:10.554055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:10.555034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 610/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:56:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 08:56:10.560199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:10.599649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:10.658175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e2a8-c92f-402a-90e9-8f3647c100b2 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:10.694008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:10.694720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:10.695003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:10.695307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:10.696043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:10.696347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:10.697735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:10.705364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 599/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:56:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:10.711106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:10.764197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:10.812228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee4903-65d3-49f5-9606-9739929c5870 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:10.846735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:10.847542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:10.847828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:10.848104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:10.857946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:10.860051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:10.877326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:10.878438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:10.879432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:10.879432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:10.879432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:10.879432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:10.879432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 611/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:10.884258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:10.982432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:10.985737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671198-9eb7-4c26-88a0-37e581314f20 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:11.017526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:11.018177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:11.018459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:11.018732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:11.019470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:11.019773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:11.021149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:11.033325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 600/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:11.038958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:11.138102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79e7d6-3dd8-4826-8a34-9d0f355d712a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:11.139643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:11.171618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:11.172413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:11.172696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:11.172972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:11.181540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:11.182985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:56:11.197452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:11.198574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:11.199909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 612/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:11.204477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:11.302946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675243a9-67e3-4145-98c7-158395fcf6db None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:11.336410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:11.337074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:11.337356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:11.337631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:11.338448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:11.338755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:11.340197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:11.357687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 601/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 08:56:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:11.363770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:11.464905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59273d-95e0-43f8-a69e-3d0d154ecd47 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:11.498063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:11.498711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:11.498997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:11.499299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:11.528392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:11.565680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:11.567126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:11.664646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 613/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:56:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:56:11.670774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:11.690299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:11.769820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148820ff-30dd-40f0-a8b2-d476ca544de4 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:11.802090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:11.802885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:11.803157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:11.803454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:11.814142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:11.818707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:11.834095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:11.835184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:11.836323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:11.836323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:11.836323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:11.836323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:11.836323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 602/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:11.841016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:11.904049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:11.942182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e13dd-e4b1-4310-a5ed-a62385c796f4 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:11.975409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:11.976065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:11.976347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:11.976627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:11.977342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:11.977645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:11.979008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:11.990859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 614/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:11.996883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:12.068597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:12.097341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3b669-2c07-469c-a48d-973ecb58619b None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:12.131328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:12.132123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:12.132410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:12.132688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:12.139405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:12.140851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:56:12.154318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:12.155439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:12.156587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 603/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:12.161399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:12.261624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd216d-045c-4c94-ae7f-de3c44087dc0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:12.283031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:12.293910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:12.294559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:12.294842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:12.295174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:12.296439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:12.296742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:12.298169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66a5b2-d509-45c3-8ad7-29741a0e7084 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:12.310777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 615/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:12.317273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:12.416236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875663a6-a92e-4828-88fe-91035817a6a0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:12.444779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:12.450614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:12.451288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:12.451569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:12.451848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:12.452711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=db6adef34dc34d9e8b67547fe54ecf08) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:12.453024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:12.454502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3e576-dd31-43c5-b744-fac97fd04282 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:12.459932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 604/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:56:12 2022] GET /identity/v3/role_assignments?user.id=db6adef34dc34d9e8b67547fe54ecf08&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:14.669082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35992b9-0e18-4d21-81bd-d7d94c29fbc9 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:14.669643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35992b9-0e18-4d21-81bd-d7d94c29fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:14.669643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35992b9-0e18-4d21-81bd-d7d94c29fbc9 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:14.671667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 616/1220] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:14.676930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:14.677373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:14.677477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:14.694311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:14.695520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:14.769338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 605/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:56:14.792702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35992b9-0e18-4d21-81bd-d7d94c29fbc9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:14.893524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35992b9-0e18-4d21-81bd-d7d94c29fbc9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:14.927730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:14.928530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:14.928818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:14.929100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:14.939711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:56:14.949818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:14.951030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:14.951952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 617/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:14.957145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:15.054634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bf396-0142-48cc-b2c2-3b78b3772820 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:15.077781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:15.088239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:15.088909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:15.089190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:15.089472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:15.090213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:15.090521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:15.091924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:15.100375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 606/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:56:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:15.106173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:15.148561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:15.201296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c873-bbe4-4b7b-bbeb-cf0e7f0730b0 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:15.233470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:15.234245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:15.234528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:15.234804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:15.244952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:15.246387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:15.263607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:15.272252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:15.273351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:15.273351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:15.273351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:15.273351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:15.273351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 618/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:15.273711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:15.368721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a45f4-41b4-455b-86cf-979ac920ca54 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:15.401938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:15.402618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:15.402903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:15.403179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:15.403923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:15.404232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:15.405601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:15.417083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 607/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:56:15.422773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:15.515593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:15.522039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c1501-23b7-4bd5-afa3-304739fff1c3 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:15.553969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:15.554769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:15.555053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:15.555360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:15.563065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:15.564539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:56:15.578951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:15.580143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:15.581510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 619/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:15.585903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:15.632628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:15.685305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bedb3c-7828-4992-bb2b-c8e04bff0b65 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:15.720062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8db922-835e-47de-8689-20010e333151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:15.720733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8db922-835e-47de-8689-20010e333151 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:15.721021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8db922-835e-47de-8689-20010e333151 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:15.721303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8db922-835e-47de-8689-20010e333151 None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:15.722134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8db922-835e-47de-8689-20010e333151 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:15.722447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8db922-835e-47de-8689-20010e333151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:15.723907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8db922-835e-47de-8689-20010e333151 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:15.742306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 608/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 08:56:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:15.748138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:15.852179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7146eb-d2f0-4fd4-ad01-6d6e5ffac426 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:15.886473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:15.887292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:15.887581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:15.887859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:15.898355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:15.899847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:15.917074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:15.918254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:15.919435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:15.919435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:15.919435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:15.919435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:15.919435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 620/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:15.924655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8db922-835e-47de-8689-20010e333151 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:16.030614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8db922-835e-47de-8689-20010e333151 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:16.034383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:16.071674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:16.072341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:16.072639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:16.072910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:16.073617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:16.073920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:16.075322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:16.086772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 609/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:16.091914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:16.101852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:16.192335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7612eb-018a-4d66-9361-a8caed26f2f5 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:16.224968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:16.225756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:16.226036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:16.226307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:16.233003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:16.235048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:56:16.249117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:16.250076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:16.251264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 621/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:16.256757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:16.354024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e059e-9fd4-4bce-a3fc-ac80b3038123 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:16.387357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:16.388019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:16.388308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:16.388588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:16.389396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:16.389734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:16.391170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1018b3-5b23-4856-b14d-5c5280d1d3ec None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:16.403306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 610/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:16.410112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:16.474705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:16.507792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1219-7a1c-4028-b850-2b6421837ece None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:16.541210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b514a6d-72bc-41dc-96a2-02a553b247ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:16.542088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b514a6d-72bc-41dc-96a2-02a553b247ea None admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:16.542372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b514a6d-72bc-41dc-96a2-02a553b247ea None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:16.542676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b514a6d-72bc-41dc-96a2-02a553b247ea None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/db6adef34dc34d9e8b67547fe54ecf08/roles/1a20c98280c544f1a2e8800bab74ddc1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:16.557435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b514a6d-72bc-41dc-96a2-02a553b247ea None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=db6adef34dc34d9e8b67547fe54ecf08, role_id=1a20c98280c544f1a2e8800bab74ddc1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:16.558861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b514a6d-72bc-41dc-96a2-02a553b247ea None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:16.696397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 622/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:56:16 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/db6adef34dc34d9e8b67547fe54ecf08/roles/1a20c98280c544f1a2e8800bab74ddc1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 08:56:18.895900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d8ef-cf90-4011-b1d6-3d867b695dfa None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:18.896452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d8ef-cf90-4011-b1d6-3d867b695dfa None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:18.896580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d8ef-cf90-4011-b1d6-3d867b695dfa None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:18.897897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 611/1233] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:18.903185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:18.903641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:18.903761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:18.920177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:18.921926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:18.987423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 623/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:56:19.011476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d8ef-cf90-4011-b1d6-3d867b695dfa None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:19.036347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:19.113054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d8ef-cf90-4011-b1d6-3d867b695dfa None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:19.146073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:19.146799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:19.147080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:19.147380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:19.157856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:56:19.165600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:19.166713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:19.167791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 612/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:19.175922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:19.220180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:19.271923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a26a05-4a40-4e73-aae2-df56eb58a273 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:19.305159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:19.305836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:19.306120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:19.306515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:19.307287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:19.307601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:19.308974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:19.317259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 624/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:19.322928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:19.407460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:19.423019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1835b45-877a-4d64-96a7-c642dbfaad18 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:19.455350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:19.456143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:19.456441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:19.456705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:19.467957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:19.469517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:19.487069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:19.488193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:19.489363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:19.489363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:19.489363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:19.489363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:19.489363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 613/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:19.494005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:19.593604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f047bca-7ab9-4096-bd6a-ee9933afedd8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:19.602868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:19.627772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:19.628431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:19.628716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:19.628992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:19.629755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:19.630061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:19.631468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:19.643130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 625/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:19.648862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:19.757614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b251-7d1c-43c3-ba4e-a0a7effe89c5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:19.791030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:19.791859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:19.792174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:19.792449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:19.795131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:19.800412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:19.801878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:56:19.815954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:19.819252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:19.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 614/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:19.822964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:19.925090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15133966-a167-49cb-a42a-c7bb6f8e5529 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:19.958815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:19.959526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:19.959850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:19.960129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:19.960969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:19.961281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:19.962693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:19.980193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 626/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:19.985956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:20.087953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a685d-9397-472f-971f-ca1e66bc6593 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:20.119913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:20.120553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:20.120834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:20.121107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:20.180626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:20.187450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:20.188909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:20.284632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 615/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:56:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:56:20.290384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:20.318073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:20.387891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c34d05-1cee-4656-885a-ff014948c158 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:20.422241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:20.423026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:20.423346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:20.423622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:20.433540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:20.434989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:20.452458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:20.453450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:20.454318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:20.454318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:20.454318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:20.454318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:20.454318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 627/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:20.459308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:20.551474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:20.557203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e51264-0967-454b-ba28-279d3ee62931 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:20.590561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:20.591221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:20.591531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:20.591809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:20.593184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:20.593502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:20.595293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:20.606762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 616/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:20.612335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:20.689857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:20.711058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d26b8c-99ed-4263-a1a7-1dd58a16917e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:20.743772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:20.744552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:20.744836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:20.745114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:20.752459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:20.753905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:56:20.768760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:20.769793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:20.771072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 628/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:20.776013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:20.872330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0e657-53ee-42b1-99d9-67564d340b9f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:20.905605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:20.906253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:20.906551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:20.906843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:20.907641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:20.907949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:20.909361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7bd33-0726-4019-b060-f85faf671a73 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:20.921175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 617/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:56:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:56:20.927251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:21.025254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6bca3-477b-4b67-a551-089c5df6b29d None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:21.058115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:21.058759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:21.059042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:21.059349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:21.060174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] RBAC: Adding query filter params (role.id=1a20c98280c544f1a2e8800bab74ddc1, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=db6adef34dc34d9e8b67547fe54ecf08) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:21.063015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:21.063015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88764f-9065-45fc-a3e0-702f79ec3dd6 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:21.068310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 629/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:56:20 2022] GET /identity/v3/role_assignments?user.id=db6adef34dc34d9e8b67547fe54ecf08&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1a20c98280c544f1a2e8800bab74ddc1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:23.355762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28fc5-0d66-46d8-908e-22307adb439b None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:23.356266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28fc5-0d66-46d8-908e-22307adb439b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:23.356266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28fc5-0d66-46d8-908e-22307adb439b None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:23.357931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 618/1247] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:23.363172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:23.363587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:23.363770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:23.368807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:23.382352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:23.383631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:23.448807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 630/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:56:23.473437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28fc5-0d66-46d8-908e-22307adb439b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:23.491339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:23.572860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28fc5-0d66-46d8-908e-22307adb439b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:23.608137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:23.608858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:23.609145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:23.609421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:23.619372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:56:23.627895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:23.629030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:23.630077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 619/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:23.635042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:23.731240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7b7c5-dcf1-4a33-88b9-1a6c24c2ba0d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:23.760942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:23.766308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:23.766969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:23.767291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:23.767562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:23.768303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:23.768610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:23.770000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:23.777990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 631/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:23.783701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:23.861144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:23.883879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37b523-aa13-41a9-8183-5a575a1694b0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:23.917259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:23.918052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:23.918336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:23.918617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:23.929740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:23.931195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:23.948464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:23.953223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:23.954142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:23.954142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:23.954142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:23.954142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:23.954142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 620/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:23.956154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:24.055339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3edec6-f3a6-4700-9d95-c3da05258ad8 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:24.087511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:24.088167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:24.088450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:24.088728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:24.089452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:24.089754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:24.091130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:24.102630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 632/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:24.108845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:24.209780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754e3b5-cbfb-41fb-a57a-dd712bb314dd None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:24.235361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:24.243057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:24.243980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:24.244262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:24.244539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:24.252634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:24.254063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:56:24.268449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:24.269593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:24.270939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 621/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:24.275495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:24.331895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:24.374652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768dfe9-c2c2-480e-addc-3cfd518b0e30 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:24.411766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:24.412440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:24.412726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:24.413001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:24.413836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:24.414145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:24.415639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:24.432939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 633/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 08:56:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:24.438719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:24.538168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837bc4e-77b0-492b-b2b7-d238eb30fc95 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:24.572735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:24.573389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:24.573677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:24.573978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:24.629452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:24.641657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:24.643152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:24.739716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 622/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:56:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:56:24.745601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:24.843845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1d713-52d9-4eeb-8eee-a1abaa5758fd None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:24.856510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:24.877250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:24.878040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:24.878325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:24.878600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:24.888281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:24.890228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:24.908672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:24.909773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:24.915074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:24.915074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:24.915074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:24.915074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:24.915074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 634/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:24.915697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:25.002694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:25.014557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d6dd4-7ec0-4214-b32e-3a3d01dee269 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:25.048314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:25.048993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:25.049348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:25.049617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:25.050329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:25.050635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:25.052043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:25.062799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 623/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:25.068632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:25.171522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64d4d-5aa2-426f-82aa-b379a1c9926e None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:25.205048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:25.205835 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:25.206111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:25.206379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:25.212853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:25.214298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:56:25.227704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:25.228784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:25.229970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 635/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:25.235085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:25.337493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f9d1f-638e-4350-b2c0-bf3f3af53dbd None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:25.369849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:25.370501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:25.370786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:25.371063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:25.371868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:25.372180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:25.374228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c371b-1671-4d7e-8b6e-5c936302c5e9 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:25.386160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 624/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:25.392757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:25.418293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:25.506777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84567ea-8231-44fc-af1d-0bc1f1f5fc85 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:25.540157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:25.540795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:25.541077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:25.541349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:25.542175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=db6adef34dc34d9e8b67547fe54ecf08) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:25.542484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:25.543932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5137c7-096a-4dab-9399-9649675e52cb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:25.549321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 636/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:56:25 2022] GET /identity/v3/role_assignments?user.id=db6adef34dc34d9e8b67547fe54ecf08&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1824060ea6e647969fbd916218fe88ea => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:27.760788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1671aa-0d40-4dfc-8e91-6864ddfbb2a6 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:27.761366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1671aa-0d40-4dfc-8e91-6864ddfbb2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:27.761366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1671aa-0d40-4dfc-8e91-6864ddfbb2a6 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:27.762707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 625/1261] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:27.768142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:27.768565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:27.768701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:27.786531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:27.787741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:27.852277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 637/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:56:27.876144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1671aa-0d40-4dfc-8e91-6864ddfbb2a6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:27.886855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:27.978298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1671aa-0d40-4dfc-8e91-6864ddfbb2a6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.013534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.014286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.014569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.014897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.024698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:56:28.032525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:28.033727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:28.034828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 626/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:28.039902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:28.058404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:28.137414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b5d7-7e3d-4152-a255-4b16c184dd08 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.171632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.172292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.172572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.172843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.173577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:28.173881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:28.175270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:28.183373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 638/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:28.189321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:28.254905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:28.287776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984cdf7-619b-4381-ab9a-99b9f0f6f32f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.320322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.321106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.321388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.321657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.331940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:28.333377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:28.351097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:28.352296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:28.353402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:28.353402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:28.353402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:28.353402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:28.353402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 627/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:28.358646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:28.438430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:28.456776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a2c1a-2ac9-4092-918e-71b94e98f813 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.489522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.490169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.490451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.490726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.491502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:28.491808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:28.493169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:28.505226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 639/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:28.510922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:28.610121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c0b4-6c34-44c4-9271-a81ff4a9293d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.630655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:28.644762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.645557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.645838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.646112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.653401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:28.655512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:56:28.669374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:28.670300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:28.671480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 628/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:28.676418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:28.773251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302575-5a9b-4dfa-bb7b-1f993bf9b9bb None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.806057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.806717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.806998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.807296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.808130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:28.808438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:28.809893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:28.818391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:28.827017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 640/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 08:56:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:28.832766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:28.934610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c80ce-3dbb-4a5c-932d-25cf2e41f5c0 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:28.968396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:28.969181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:28.969501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:28.969741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:28.979941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:28.981424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:28.998212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:28.999882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:29.001262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:29.001262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:29.001262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:29.001262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:29.001262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 629/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:29.006026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:29.102390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd05b6-7dae-468a-8a07-dbb7b47f8416 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:29.138953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:29.140204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:29.140483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:29.140757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:29.141470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:29.141774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:29.143134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:29.154043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 641/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:29.159772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:29.191605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:29.260124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702363d1-6d0e-434d-8858-564a2c4314fa None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:29.293913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:29.294711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:29.295031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:29.295806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:29.302424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:29.303917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:56:29.318670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:29.319890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:29.321164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 630/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:56:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:29.325654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:29.384377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:29.424346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14896-9bdd-475e-8572-0f1ad41ae237 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:29.457419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:29.458019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:29.458308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:29.458590 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:29.459406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:29.459718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:29.461152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b2005-4b99-45b8-883a-48ed58d1e2a9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:29.472893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 642/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:56:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:29.478896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:29.570485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:29.578974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d5cc-adaa-40ac-814d-4526889908ec None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:29.616541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5e32a-4b2f-43f8-98e0-466644d5ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:29.617425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e32a-4b2f-43f8-98e0-466644d5ae56 None admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:29.617708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e32a-4b2f-43f8-98e0-466644d5ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:29.617978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5e32a-4b2f-43f8-98e0-466644d5ae56 None admin] PATH_INFO: `/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/db6adef34dc34d9e8b67547fe54ecf08/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:29.619925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5e32a-4b2f-43f8-98e0-466644d5ae56 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b95c39fe1b54ea284ba0cf6156db620, user_id=db6adef34dc34d9e8b67547fe54ecf08, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:29.621404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5e32a-4b2f-43f8-98e0-466644d5ae56 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:29.708652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 631/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 2 08:56:29 2022] PUT /identity/v3/projects/6b95c39fe1b54ea284ba0cf6156db620/users/db6adef34dc34d9e8b67547fe54ecf08/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 08:56:31.953517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e6af1-fd32-4624-8d6f-89da0170aada None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:31.954061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e6af1-fd32-4624-8d6f-89da0170aada None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:31.954061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e6af1-fd32-4624-8d6f-89da0170aada None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:31.955595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 643/1274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:31.960921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:31.961389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:31.961600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:31.978247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:31.979468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:32.047654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 632/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 08:56:32.070995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e6af1-fd32-4624-8d6f-89da0170aada None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:32.170261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e6af1-fd32-4624-8d6f-89da0170aada None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:32.187665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:32.203676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:32.204454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:32.204735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:32.205013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:32.214841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 08:56:32.223045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:32.224206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:32.225098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 644/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 2 08:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:32.230371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:32.311317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:32.329229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d53e3-4e4b-40ad-8b07-a6e872946a8d None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:32.362985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:32.363676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:32.363964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:32.364246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:32.364992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:32.365303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:32.366719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:32.374573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 633/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 2 08:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:32.380478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:32.481144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9b451-b9cf-4731-bac8-cb1d0e8418aa None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:32.516717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:32.517520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:32.518318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:32.518318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:32.529508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:32.531584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:32.548228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:32.554943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:32.556112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:32.556112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:32.556112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:32.556112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:32.556112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 645/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:32.556473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:32.661215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44e52-5134-4493-b7fd-c15bb62eb35e None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:32.704490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:32.705186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:32.705468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:32.705741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:32.706553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:32.706945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:32.708477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:32.721947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 634/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:32.727684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:32.761143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:32.834977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37501a-a70e-4644-a5db-72d39fa03aff None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:32.870895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:32.871745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:32.872032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:32.872311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:32.881517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:32.882995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 08:56:32.898910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:32.900247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:32.906163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 646/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:32.908028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:32.912168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:33.011990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171ee3-60cc-48a0-bbb8-5b304bd6cea5 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:33.050189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:33.050875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:33.051156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:33.051467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:33.052304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:33.052616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:33.054040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:33.071923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 635/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 2 08:56:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:33.077774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:33.170835 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:33.180229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372b22-8d5b-4447-b215-55d4851a0687 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:33.212350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:33.212988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:33.213269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:33.213542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:33.279691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:33.281100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:33.366946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:33.377260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 647/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 2 08:56:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 08:56:33.383039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:33.442835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:33.479684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d8c68-018a-406a-8326-6137fa9b2a5f None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:33.513609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:33.514413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:33.514700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:33.514974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:33.524802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:33.526302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 08:56:33.543828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:33.544926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:33.551026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 08:56:33.551026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 08:56:33.551026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 08:56:33.551026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:33.551026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 636/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 08:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:33.551405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:33.649241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef2727-b065-42f3-9e42-6fc16aac6ab9 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:33.683200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:33.683884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:33.684166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:33.684442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:33.685154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:33.685458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:33.687356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:33.698367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 648/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 2 08:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 08:56:33.704830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:33.804994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68771-292a-4127-abb9-8a2a264bd70d None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:33.819162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:33.839945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:33.840732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:33.841017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:33.841294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:33.847805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:33.849264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 08:56:33.863530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:33.864578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: ERROR keystone.server.flask.application Jun 02 08:56:33.870316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 637/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 2 08:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:33.870964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:33.919761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:33.971698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100ded4-bc8a-4e0a-9d00-c750854b4b36 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:34.008230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:34.008884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:34.009164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:34.009437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:34.010281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:34.010587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:34.012043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327337e-43f8-4d43-a479-e1f64a07e181 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:34.023743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 649/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 2 08:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:34.029831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:34.130021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe2a00-e85e-40d3-afd3-c3ef9a145976 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:34.163474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:34.164118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:34.164400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:34.164673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:34.165486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] RBAC: Adding query filter params (role.id=1824060ea6e647969fbd916218fe88ea, scope.project.id=6b95c39fe1b54ea284ba0cf6156db620, user.id=db6adef34dc34d9e8b67547fe54ecf08) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:34.165795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:34.167217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61336226-3fdc-4e6e-8eb6-3ccffa0d9b8c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:34.173704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 638/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 2 08:56:34 2022] GET /identity/v3/role_assignments?user.id=db6adef34dc34d9e8b67547fe54ecf08&scope.project.id=6b95c39fe1b54ea284ba0cf6156db620&role.id=1824060ea6e647969fbd916218fe88ea => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:36.417658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace8861-42e8-42e0-98f7-e9b20054cb22 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:36.418236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace8861-42e8-42e0-98f7-e9b20054cb22 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:36.418236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace8861-42e8-42e0-98f7-e9b20054cb22 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:36.419615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 650/1288] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:36.425502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:36.426012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:36.426111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:36.443152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:36.444383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:36.473468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:36.509222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 639/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:56:36.531895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace8861-42e8-42e0-98f7-e9b20054cb22 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:36.630539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace8861-42e8-42e0-98f7-e9b20054cb22 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:36.640899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:36.663402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:36.664189 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:36.664472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:36.664748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:36.665396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:36.666761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:36.679206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:36.680384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:36.681483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 651/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:56:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:36.686395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:36.783349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc654-3dd7-4dd8-b990-99acbb596e83 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:36.815894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:36.816552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:36.816837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:36.817117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:36.817817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:36.818126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:36.819517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a8b97-9af5-42b7-85a2-7499b35ea648 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:36.824275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 640/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 08:56:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:36.830456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:36.930758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeae5b-ba08-4eff-8a73-ef09290efbfe None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:36.964124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:36.964785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:36.965075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:36.965357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] PATH_INFO: `/v3/services` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:36.966065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:36.966379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:36.968329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0b84b-9076-4cc4-a1bd-9194baad4acd None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:36.973096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 652/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 08:56:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:39.182280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db489-99c7-48cc-a376-b5f34abca6f5 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:39.182819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db489-99c7-48cc-a376-b5f34abca6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:39.182819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db489-99c7-48cc-a376-b5f34abca6f5 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:39.184149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 641/1293] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:39.189440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47646-2fc7-4dbd-8b2c-d71d4feb6977 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:39.193282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47646-2fc7-4dbd-8b2c-d71d4feb6977 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:39.193282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47646-2fc7-4dbd-8b2c-d71d4feb6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:39.207733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fcf47646-2fc7-4dbd-8b2c-d71d4feb6977 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:39.208956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fcf47646-2fc7-4dbd-8b2c-d71d4feb6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:39.238900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:39.275222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 653/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:56:39.298767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4db489-99c7-48cc-a376-b5f34abca6f5 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:39.329165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:39.400615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4db489-99c7-48cc-a376-b5f34abca6f5 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:39.433108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514c2cc-65ab-4013-a2c5-08bce2fa48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:39.433725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c2cc-65ab-4013-a2c5-08bce2fa48ab None admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:39.434106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c2cc-65ab-4013-a2c5-08bce2fa48ab None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:39.434385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c2cc-65ab-4013-a2c5-08bce2fa48ab None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:39.435107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514c2cc-65ab-4013-a2c5-08bce2fa48ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:39.437020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514c2cc-65ab-4013-a2c5-08bce2fa48ab None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:39.484950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 642/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 2 08:56:39 2022] POST /identity/v3/services => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:56:41.740016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21e69-be3a-442f-80b9-f0c6b08ede9d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:41.740573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21e69-be3a-442f-80b9-f0c6b08ede9d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:41.740573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21e69-be3a-442f-80b9-f0c6b08ede9d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:41.741956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 654/1296] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:41.747987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:41.747987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:41.747987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:41.765046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:41.766214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:41.837524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 643/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:56:41.861847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21e69-be3a-442f-80b9-f0c6b08ede9d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:41.966167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21e69-be3a-442f-80b9-f0c6b08ede9d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:42.000268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:42.001258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:42.001543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:42.001813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:42.002452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:42.003900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:42.016955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:42.018178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:42.019102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 655/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:56:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:42.024981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:42.047452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:42.125192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d572c-ec62-4c06-8777-c6322c59f3a7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:42.160419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:42.161087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:42.161375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:42.161654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:42.162358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:42.162668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:42.164081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:42.169142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 644/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 08:56:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:42.175177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:42.206025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:42.271767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283cc40-3b18-4520-b5fc-c352016fe69a None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:42.306276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:42.306920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:42.307201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:42.307506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:42.308286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] RBAC: Adding query filter params (interface=public, service_id=756c97a227dc41c8a9c786f4b54c1ddb, region_id=RegionOne) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:42.308596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:42.309974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd879b-87a9-4fab-bee4-f14ef0245eca None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:42.314951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 656/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 2 08:56:42 2022] GET /identity/v3/endpoints?service_id=756c97a227dc41c8a9c786f4b54c1ddb&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:42.320587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:42.402256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:42.420023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e097-5ce8-46bb-b2d8-1af58c833117 None admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:42.453956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa58d-2de9-4240-93cc-0ff9c4e47186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:42.454639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa58d-2de9-4240-93cc-0ff9c4e47186 None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:42.454919 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa58d-2de9-4240-93cc-0ff9c4e47186 None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:42.455195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa58d-2de9-4240-93cc-0ff9c4e47186 None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:42.455895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa58d-2de9-4240-93cc-0ff9c4e47186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:42.457268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa58d-2de9-4240-93cc-0ff9c4e47186 None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:42.464046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 645/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 2 08:56:42 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 08:56:44.697116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3266e6f-28a1-4f37-af94-747d6405a5db None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:44.697663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3266e6f-28a1-4f37-af94-747d6405a5db None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:44.697663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3266e6f-28a1-4f37-af94-747d6405a5db None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:44.699063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 657/1302] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 08:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 08:56:44.705302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:44.705958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:44.705958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:44.721813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 08:56:44.722986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 08:56:44.791472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 646/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 08:56:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 08:56:44.814886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3266e6f-28a1-4f37-af94-747d6405a5db None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:44.907786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:44.914298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3266e6f-28a1-4f37-af94-747d6405a5db None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:44.948010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:44.948794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:44.949059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:44.949334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:44.949979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:44.951399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 08:56:44.963838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 08:56:44.965060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application with Lock( Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self._enter() Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application return self.creator() Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application created_value = creator( Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: ERROR keystone.server.flask.application Jun 02 08:56:44.966037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 658/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 2 08:56:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 08:56:44.971310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:45.047522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:45.070994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447b4e-f9b9-44c2-8c2f-0ddd0ebcdade None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:45.106710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:45.107427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:45.107706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:45.108471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] PATH_INFO: `/v3/services` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:45.109162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 08:56:45.109466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:45.110828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93007f-1dd8-4e6f-9c50-89c3e1ca300c None admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:45.115925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 647/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 2 08:56:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 08:56:45.121905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 08:56:45.221788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff190-2374-4ba4-8e1f-084926a90e46 None admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 08:56:45.255785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d0f2e-cdee-4fb3-b3f9-cf9a46e3e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 08:56:45.256437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0f2e-cdee-4fb3-b3f9-cf9a46e3e848 None admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 08:56:45.256722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0f2e-cdee-4fb3-b3f9-cf9a46e3e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 08:56:45.256997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0f2e-cdee-4fb3-b3f9-cf9a46e3e848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 08:56:45.257743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d0f2e-cdee-4fb3-b3f9-cf9a46e3e848 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 08:56:45.259133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d0f2e-cdee-4fb3-b3f9-cf9a46e3e848 None admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 08:56:45.377390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 659/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 2 08:56:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 08:56:55.112859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=30 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 08:56:55.372549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:33.614911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600036-1081-490e-bd58-d9ea220d4c82 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:33.615463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600036-1081-490e-bd58-d9ea220d4c82 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:33.615559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600036-1081-490e-bd58-d9ea220d4c82 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:33.622075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3a3c-1210-471b-a967-326779854cef None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:33.622507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3a3c-1210-471b-a967-326779854cef None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:33.622742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3a3c-1210-471b-a967-326779854cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:33.626198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 648/1307] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:33.704853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-08cb3a3c-1210-471b-a967-326779854cef None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:33.706368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-08cb3a3c-1210-471b-a967-326779854cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:33.924005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 660/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:02:33.962471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5bec-68e3-4e6e-9fac-2e7b387311ae None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:33.962773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5bec-68e3-4e6e-9fac-2e7b387311ae None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:33.963085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a5bec-68e3-4e6e-9fac-2e7b387311ae None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:33.965332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 649/1309] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jun 2 09:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:33.971464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534f93-3465-405e-acc0-dcd14d9ac953 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:33.971764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534f93-3465-405e-acc0-dcd14d9ac953 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:33.972044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534f93-3465-405e-acc0-dcd14d9ac953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:34.059319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6f534f93-3465-405e-acc0-dcd14d9ac953 None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:34.060636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6f534f93-3465-405e-acc0-dcd14d9ac953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:34.081730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:34.140092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 661/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jun 2 09:02:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:34.148864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5bec-68e3-4e6e-9fac-2e7b387311ae None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:34.150664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ca1a5bec-68e3-4e6e-9fac-2e7b387311ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:34.269974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a5bec-68e3-4e6e-9fac-2e7b387311ae None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:34.348140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:34.348714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:34.348998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:34.349270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:34.350924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:34.408857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:34.468036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:34.469460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b6f96-91df-402f-9ae7-155ac2f8aa93 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:34.621812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 650/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:02:37.145486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c218be7-b746-4d77-b383-021403891826 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:37.145966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c218be7-b746-4d77-b383-021403891826 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:37.145966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c218be7-b746-4d77-b383-021403891826 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:37.151461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 662/1312] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:37.153556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196ec9-89e1-42fc-9d6f-70f7931f49fc None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:37.153974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196ec9-89e1-42fc-9d6f-70f7931f49fc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:37.154065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196ec9-89e1-42fc-9d6f-70f7931f49fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:37.240122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d9196ec9-89e1-42fc-9d6f-70f7931f49fc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:37.241378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d9196ec9-89e1-42fc-9d6f-70f7931f49fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:37.350288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 651/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:02:37.388898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c218be7-b746-4d77-b383-021403891826 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:37.390521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4c218be7-b746-4d77-b383-021403891826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:37.500637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c218be7-b746-4d77-b383-021403891826 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:37.576250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:37.578874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:37.579692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:37.579880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:37.580135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:37.583408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:37.700005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:37.701524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a263db1-fda2-40fa-8fe3-6b1270f199a2 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:37.721717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 663/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:02:40.526052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5779-600e-41b7-812d-567436d02aeb None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:40.526587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5779-600e-41b7-812d-567436d02aeb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:40.526587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5779-600e-41b7-812d-567436d02aeb None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:40.528593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 652/1315] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:40.533711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a33a-0bbb-416b-a953-8a28ff0b4dc0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:40.534089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a33a-0bbb-416b-a953-8a28ff0b4dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:40.534272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6a33a-0bbb-416b-a953-8a28ff0b4dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:40.597462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7aa6a33a-0bbb-416b-a953-8a28ff0b4dc0 None None] MFA Rules not processed for user `50b4717896c84af8a7c8d8637a93ba49`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:40.598676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7aa6a33a-0bbb-416b-a953-8a28ff0b4dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:40.649078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:40.693436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 664/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:40.748204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bf3dc-8a0d-49fe-88d4-74eb2955da0e None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:40.748493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bf3dc-8a0d-49fe-88d4-74eb2955da0e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:40.748779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bf3dc-8a0d-49fe-88d4-74eb2955da0e None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:40.750142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 653/1317] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jun 2 09:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:40.755783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a5d8-5b0a-4178-b869-ae972f061cc6 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:40.756116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a5d8-5b0a-4178-b869-ae972f061cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:40.756399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a5d8-5b0a-4178-b869-ae972f061cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:40.830073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-28a7a5d8-5b0a-4178-b869-ae972f061cc6 None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:40.831223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-28a7a5d8-5b0a-4178-b869-ae972f061cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:40.907076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 665/1318] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jun 2 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:40.915965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bf3dc-8a0d-49fe-88d4-74eb2955da0e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:40.917493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-905bf3dc-8a0d-49fe-88d4-74eb2955da0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:40.927100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:41.022750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bf3dc-8a0d-49fe-88d4-74eb2955da0e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:41.094852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:41.095435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:41.095721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:41.095998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:41.097649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:41.159506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:41.205300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:41.206747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21bd0-61e1-437e-9018-8a9dbc3f9575 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:41.224800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 654/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:02:44.640659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906f50-8a22-467c-aa5c-e37f847ea119 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:44.641223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906f50-8a22-467c-aa5c-e37f847ea119 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:44.641223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7906f50-8a22-467c-aa5c-e37f847ea119 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:44.642622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 666/1320] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:44.648066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da7977-8ee2-4f5e-99fe-70e886750cfe None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:44.648460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da7977-8ee2-4f5e-99fe-70e886750cfe None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:44.648625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da7977-8ee2-4f5e-99fe-70e886750cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:44.711815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-84da7977-8ee2-4f5e-99fe-70e886750cfe None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:44.721470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-84da7977-8ee2-4f5e-99fe-70e886750cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:44.809692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 655/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:44.848085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906f50-8a22-467c-aa5c-e37f847ea119 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:44.849678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f7906f50-8a22-467c-aa5c-e37f847ea119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:44.902345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:44.958411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7906f50-8a22-467c-aa5c-e37f847ea119 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:45.032677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:45.033329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:45.033620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:45.033901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:45.035580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:45.130488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:45.144298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:45.145776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c78ab-e397-4f85-96e8-18d2784d6ab4 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:45.164579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 667/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:02:48.403314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3cf70-1369-4727-a933-5ef5678802e5 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:48.403959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3cf70-1369-4727-a933-5ef5678802e5 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:48.403959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3cf70-1369-4727-a933-5ef5678802e5 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:48.405240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 656/1323] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:48.410441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7fd4-0d83-49c7-9a07-fe127da6f3d1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:48.410895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7fd4-0d83-49c7-9a07-fe127da6f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:48.411120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7fd4-0d83-49c7-9a07-fe127da6f3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:48.476546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-eb7d7fd4-0d83-49c7-9a07-fe127da6f3d1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:48.477735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-eb7d7fd4-0d83-49c7-9a07-fe127da6f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:48.701880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 668/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:48.736655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3cf70-1369-4727-a933-5ef5678802e5 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:48.738202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8b3cf70-1369-4727-a933-5ef5678802e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:48.758009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:48.845039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3cf70-1369-4727-a933-5ef5678802e5 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:48.920372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:48.921026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:48.921325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:48.921594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:48.923283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:49.004044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:49.047224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:49.048692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e870c-dd31-418c-aaa8-cfd35fee70cb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:49.067634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 657/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:02:51.378647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705082b-9359-4e0b-a6ba-c9c40b918743 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:51.379301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705082b-9359-4e0b-a6ba-c9c40b918743 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:51.379301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705082b-9359-4e0b-a6ba-c9c40b918743 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:51.380761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 669/1326] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:51.386681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4007-4e8e-4dad-8acf-76118d59989f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:51.387084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4007-4e8e-4dad-8acf-76118d59989f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:51.387454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b4007-4e8e-4dad-8acf-76118d59989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:51.451980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8c4b4007-4e8e-4dad-8acf-76118d59989f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:51.453282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8c4b4007-4e8e-4dad-8acf-76118d59989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:51.549263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 658/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:51.585151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705082b-9359-4e0b-a6ba-c9c40b918743 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:51.586712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6705082b-9359-4e0b-a6ba-c9c40b918743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:51.648458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:51.694462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705082b-9359-4e0b-a6ba-c9c40b918743 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:51.767258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:51.767933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:51.768216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:51.768511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:51.770209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:51.875289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:51.877725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:51.879208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e764f-2ca4-4415-adff-77e932be6d60 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:51.897586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 670/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:02:54.222516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c77f-2daf-4db2-a84e-efe9936a4ca6 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:54.223071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c77f-2daf-4db2-a84e-efe9936a4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:54.223071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c77f-2daf-4db2-a84e-efe9936a4ca6 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:54.224640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 659/1329] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:54.229895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4b165-1c1e-453b-b6ab-0a8a671c58a7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:54.230348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4b165-1c1e-453b-b6ab-0a8a671c58a7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:54.230492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4b165-1c1e-453b-b6ab-0a8a671c58a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:54.297883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-def4b165-1c1e-453b-b6ab-0a8a671c58a7 None None] MFA Rules not processed for user `50b4717896c84af8a7c8d8637a93ba49`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:54.299067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-def4b165-1c1e-453b-b6ab-0a8a671c58a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:54.393948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 671/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:54.431756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c77f-2daf-4db2-a84e-efe9936a4ca6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:54.433820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fb95c77f-2daf-4db2-a84e-efe9936a4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:54.464012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:54.539756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c77f-2daf-4db2-a84e-efe9936a4ca6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:54.612569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:54.613221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:54.613499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:54.613770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:54.615432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:54.692462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:54.725928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:54.727400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddbb3e-9cbc-4d86-863a-b611eaf99fc7 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:54.745855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 660/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:02:57.408974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2bcd5-242a-4985-bd28-2e66bf2fad97 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:57.409495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2bcd5-242a-4985-bd28-2e66bf2fad97 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:57.409495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2bcd5-242a-4985-bd28-2e66bf2fad97 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:57.410862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 672/1332] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:02:57.416213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b896e8-ac65-4c4f-96d2-3bf85923b3df None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:57.416617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b896e8-ac65-4c4f-96d2-3bf85923b3df None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:57.416765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b896e8-ac65-4c4f-96d2-3bf85923b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:57.480760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-33b896e8-ac65-4c4f-96d2-3bf85923b3df None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:02:57.481915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-33b896e8-ac65-4c4f-96d2-3bf85923b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:57.578858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 661/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:02:57.613887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2bcd5-242a-4985-bd28-2e66bf2fad97 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:02:57.615436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2eb2bcd5-242a-4985-bd28-2e66bf2fad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:57.684282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:57.718213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2bcd5-242a-4985-bd28-2e66bf2fad97 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:02:57.791144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:02:57.791816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:02:57.792121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:02:57.792391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:02:57.794011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:02:57.909794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:02:57.911005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df15e7-4ea9-4b33-81bb-b9e4549eeb1b service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:02:57.923167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:02:57.939540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 673/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:00.245323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9804ba-45b3-4ed0-9725-a48dc93e515c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:00.245859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9804ba-45b3-4ed0-9725-a48dc93e515c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:00.245859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9804ba-45b3-4ed0-9725-a48dc93e515c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:00.247254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 662/1335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:00.252568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88115e-4840-42f6-98f3-7967fcb72493 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:00.252953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88115e-4840-42f6-98f3-7967fcb72493 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:00.253131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88115e-4840-42f6-98f3-7967fcb72493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:00.317031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6f88115e-4840-42f6-98f3-7967fcb72493 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:00.318212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6f88115e-4840-42f6-98f3-7967fcb72493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:00.412808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 674/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:00.452671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9804ba-45b3-4ed0-9725-a48dc93e515c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:00.456657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cd9804ba-45b3-4ed0-9725-a48dc93e515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:00.493625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:00.558290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9804ba-45b3-4ed0-9725-a48dc93e515c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:00.629985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:00.630639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:00.634195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:00.634195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:00.634195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:00.715090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:00.739437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:00.740868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6b213-e8c6-47c7-89f6-14d8ffd193fd service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:00.759511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 663/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:03:03.524281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b06e7-5dea-4dfd-b1b6-f371b8384d0d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:03.524840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b06e7-5dea-4dfd-b1b6-f371b8384d0d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:03.524840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b06e7-5dea-4dfd-b1b6-f371b8384d0d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:03.526252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 675/1338] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:03.531495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d949d4-2a98-4cc1-9fc3-86c15d9eb5c4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:03.531917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d949d4-2a98-4cc1-9fc3-86c15d9eb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:03.532051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d949d4-2a98-4cc1-9fc3-86c15d9eb5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:03.596299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e6d949d4-2a98-4cc1-9fc3-86c15d9eb5c4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:03.597493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e6d949d4-2a98-4cc1-9fc3-86c15d9eb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:03.692375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 664/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:03.728014 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b06e7-5dea-4dfd-b1b6-f371b8384d0d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:03.730986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9b0b06e7-5dea-4dfd-b1b6-f371b8384d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:03.812110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:03.840726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b06e7-5dea-4dfd-b1b6-f371b8384d0d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:03.852954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:03.853595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:03.853875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:03.854146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:03.856277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:03.958350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:03.959830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f21dcb-ca77-4e37-a6a5-ce15c0e4ee11 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:03.980345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 676/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:08.601298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59a74-4762-44c3-bfe0-aab155bc5f54 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:08.601831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59a74-4762-44c3-bfe0-aab155bc5f54 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:08.602273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59a74-4762-44c3-bfe0-aab155bc5f54 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:08.603691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 665/1341] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:08.609409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb4800-130a-404b-ad43-b7bbfc988030 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:08.609892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb4800-130a-404b-ad43-b7bbfc988030 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:08.610032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb4800-130a-404b-ad43-b7bbfc988030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:08.662160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-78cb4800-130a-404b-ad43-b7bbfc988030 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:08.663402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-78cb4800-130a-404b-ad43-b7bbfc988030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:08.714270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:08.741384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 677/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:08.780786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59a74-4762-44c3-bfe0-aab155bc5f54 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:08.782902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-71e59a74-4762-44c3-bfe0-aab155bc5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:08.805696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59a74-4762-44c3-bfe0-aab155bc5f54 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:08.811536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f7854-2cfc-4139-8c7e-6d9b906de521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:08.812191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f7854-2cfc-4139-8c7e-6d9b906de521 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:08.812477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f7854-2cfc-4139-8c7e-6d9b906de521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:08.812753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f7854-2cfc-4139-8c7e-6d9b906de521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:08.821874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f7854-2cfc-4139-8c7e-6d9b906de521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:08.823888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f7854-2cfc-4139-8c7e-6d9b906de521 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:08.833444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 666/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:11.968464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de1b3-bff6-4e47-8189-f4ab14c4e67c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:11.968984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de1b3-bff6-4e47-8189-f4ab14c4e67c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:11.968984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de1b3-bff6-4e47-8189-f4ab14c4e67c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:11.970400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 678/1344] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:11.975723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b947c7-d4de-43fa-bc16-6b02d427b79f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:11.976143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b947c7-d4de-43fa-bc16-6b02d427b79f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:11.976439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b947c7-d4de-43fa-bc16-6b02d427b79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:12.003809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d8b947c7-d4de-43fa-bc16-6b02d427b79f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:12.004998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8b947c7-d4de-43fa-bc16-6b02d427b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:12.013444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 667/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:12.050745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de1b3-bff6-4e47-8189-f4ab14c4e67c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:12.061843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de1b3-bff6-4e47-8189-f4ab14c4e67c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:12.065305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222493b-66b0-488b-b71e-b10d018bc755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:12.065938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222493b-66b0-488b-b71e-b10d018bc755 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:12.066244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222493b-66b0-488b-b71e-b10d018bc755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:12.066518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222493b-66b0-488b-b71e-b10d018bc755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:12.075350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222493b-66b0-488b-b71e-b10d018bc755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:12.077090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222493b-66b0-488b-b71e-b10d018bc755 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:12.086325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 679/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:16.543096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879841df-c0f8-4095-b4f9-6acdfca03543 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:16.543685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879841df-c0f8-4095-b4f9-6acdfca03543 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:16.543685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879841df-c0f8-4095-b4f9-6acdfca03543 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:16.545082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 668/1347] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:16.550405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9e7d-86bf-499a-a2d2-dd59ba642fbb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:16.550803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9e7d-86bf-499a-a2d2-dd59ba642fbb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:16.551084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9e7d-86bf-499a-a2d2-dd59ba642fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:16.568740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4afd9e7d-86bf-499a-a2d2-dd59ba642fbb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:16.569921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4afd9e7d-86bf-499a-a2d2-dd59ba642fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:16.578488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 680/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:16.615895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879841df-c0f8-4095-b4f9-6acdfca03543 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:16.626901 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879841df-c0f8-4095-b4f9-6acdfca03543 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:16.630421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57edcf-ddf4-4fbb-a4d6-103090e9eafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:16.631062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57edcf-ddf4-4fbb-a4d6-103090e9eafb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:16.631390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57edcf-ddf4-4fbb-a4d6-103090e9eafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:16.631699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57edcf-ddf4-4fbb-a4d6-103090e9eafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:16.638198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:16.641711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57edcf-ddf4-4fbb-a4d6-103090e9eafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:16.643201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57edcf-ddf4-4fbb-a4d6-103090e9eafb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:16.653342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 669/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:22.051052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825352ca-e7cf-4d16-b8b8-ad40bcd71306 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:22.051946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825352ca-e7cf-4d16-b8b8-ad40bcd71306 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:22.052387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825352ca-e7cf-4d16-b8b8-ad40bcd71306 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:22.054188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 681/1350] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:22.061965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91e2ae-3bcb-4613-9e47-140a1e002787 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:22.062783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91e2ae-3bcb-4613-9e47-140a1e002787 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:22.063294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91e2ae-3bcb-4613-9e47-140a1e002787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:22.178746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ed91e2ae-3bcb-4613-9e47-140a1e002787 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:22.180010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ed91e2ae-3bcb-4613-9e47-140a1e002787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:22.313562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 670/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:03:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:26.563547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=19 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:26.617078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbc6ef-adec-4391-ab70-6405db80a45d None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:26.617479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbc6ef-adec-4391-ab70-6405db80a45d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:26.617728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbc6ef-adec-4391-ab70-6405db80a45d None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:26.619229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 682/1352] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:26.624711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a4510-f1d6-4847-a959-69c9101577fc None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:26.625199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a4510-f1d6-4847-a959-69c9101577fc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:26.625290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a4510-f1d6-4847-a959-69c9101577fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:26.645273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6c0a4510-f1d6-4847-a959-69c9101577fc None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:26.646884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6c0a4510-f1d6-4847-a959-69c9101577fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:26.655912 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 671/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:03:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:28.170928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a81c-8b07-4b4f-9cfb-eb0f3359b0b5 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:28.171488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a81c-8b07-4b4f-9cfb-eb0f3359b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:28.171488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a81c-8b07-4b4f-9cfb-eb0f3359b0b5 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:28.172868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 683/1354] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:28.177857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230250-b3cf-429a-9e79-f60600b22e76 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:28.178260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230250-b3cf-429a-9e79-f60600b22e76 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:28.178414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230250-b3cf-429a-9e79-f60600b22e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:28.198289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1c230250-b3cf-429a-9e79-f60600b22e76 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:28.199521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1c230250-b3cf-429a-9e79-f60600b22e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:28.208033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 672/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:03:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:03:32.061235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203484-eed0-4be5-928a-345d6b6b746a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:32.061742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203484-eed0-4be5-928a-345d6b6b746a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:32.061742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203484-eed0-4be5-928a-345d6b6b746a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:32.063217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 684/1356] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:32.068453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6c93-08b9-4aa8-9377-da48b99b2175 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:32.068850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6c93-08b9-4aa8-9377-da48b99b2175 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:32.069020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6c93-08b9-4aa8-9377-da48b99b2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:32.087360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2c0d6c93-08b9-4aa8-9377-da48b99b2175 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:32.089078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2c0d6c93-08b9-4aa8-9377-da48b99b2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:32.097821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 673/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:32.154044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21de1d8-17be-4784-9874-d035c534405a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:32.154678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21de1d8-17be-4784-9874-d035c534405a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:32.155202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21de1d8-17be-4784-9874-d035c534405a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:32.157336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 685/1358] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 09:03:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:32.166897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4586c-be48-43ad-9ab0-c2c6283cd90b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:32.168242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4586c-be48-43ad-9ab0-c2c6283cd90b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:32.168998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4586c-be48-43ad-9ab0-c2c6283cd90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:32.220206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-bef4586c-be48-43ad-9ab0-c2c6283cd90b None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:32.221450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-bef4586c-be48-43ad-9ab0-c2c6283cd90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:32.279429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:32.321540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 674/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 09:03:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:03:32.330674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21de1d8-17be-4784-9874-d035c534405a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:32.346628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21de1d8-17be-4784-9874-d035c534405a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:32.354656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de1e41-90e5-4a1c-82a6-c640504e198b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:32.356175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de1e41-90e5-4a1c-82a6-c640504e198b service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:32.356665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de1e41-90e5-4a1c-82a6-c640504e198b service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:32.357059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de1e41-90e5-4a1c-82a6-c640504e198b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:32.367018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de1e41-90e5-4a1c-82a6-c640504e198b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:32.368640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de1e41-90e5-4a1c-82a6-c640504e198b service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:32.379787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 686/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:03:34.834761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdf906-3320-4a9c-863e-4a3a72d5c1c2 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:34.835463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdf906-3320-4a9c-863e-4a3a72d5c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:34.835463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdf906-3320-4a9c-863e-4a3a72d5c1c2 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:34.837007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 675/1361] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:34.842983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eecf5e-1e3f-4e37-9d9f-11e232c99caa None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:34.843688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eecf5e-1e3f-4e37-9d9f-11e232c99caa None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:34.843982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eecf5e-1e3f-4e37-9d9f-11e232c99caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:34.861820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-49eecf5e-1e3f-4e37-9d9f-11e232c99caa None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:34.863039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49eecf5e-1e3f-4e37-9d9f-11e232c99caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:34.871629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 687/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:34.918336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdf906-3320-4a9c-863e-4a3a72d5c1c2 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:34.936444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdf906-3320-4a9c-863e-4a3a72d5c1c2 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:34.942004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f806a2-0140-460c-94c3-178ccaf9d05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:34.942657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f806a2-0140-460c-94c3-178ccaf9d05c service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:34.942941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f806a2-0140-460c-94c3-178ccaf9d05c service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:34.943222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f806a2-0140-460c-94c3-178ccaf9d05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:34.952893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f806a2-0140-460c-94c3-178ccaf9d05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:34.954493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f806a2-0140-460c-94c3-178ccaf9d05c service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:34.965346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 676/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:37.755793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687a85-65c2-4e46-96a0-0f0afd801327 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:37.756605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687a85-65c2-4e46-96a0-0f0afd801327 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:37.757032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687a85-65c2-4e46-96a0-0f0afd801327 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:37.758913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 688/1364] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:37.765530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61e11f-cd38-4208-9c3d-a019340c4af7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:37.766310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61e11f-cd38-4208-9c3d-a019340c4af7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:37.766734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61e11f-cd38-4208-9c3d-a019340c4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:37.788041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ec61e11f-cd38-4208-9c3d-a019340c4af7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:37.789579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ec61e11f-cd38-4208-9c3d-a019340c4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:37.798096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 677/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:37.848655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656716d-0f8a-4eab-93c3-9403ef462c69 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:37.848964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656716d-0f8a-4eab-93c3-9403ef462c69 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:37.849239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656716d-0f8a-4eab-93c3-9403ef462c69 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:37.850606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 689/1366] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 09:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:37.856140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6803-e4cc-4611-ad27-d2cf6550e536 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:37.856426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6803-e4cc-4611-ad27-d2cf6550e536 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:37.856703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6803-e4cc-4611-ad27-d2cf6550e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:37.876439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fb7e6803-e4cc-4611-ad27-d2cf6550e536 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:37.877707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fb7e6803-e4cc-4611-ad27-d2cf6550e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:37.894723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 678/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 09:03:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:03:37.903212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656716d-0f8a-4eab-93c3-9403ef462c69 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:37.918549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656716d-0f8a-4eab-93c3-9403ef462c69 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:37.924644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d49202-dc97-44d6-bfc2-4d32992c01a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:37.926042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d49202-dc97-44d6-bfc2-4d32992c01a4 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:37.926492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d49202-dc97-44d6-bfc2-4d32992c01a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:37.927469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d49202-dc97-44d6-bfc2-4d32992c01a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:37.943078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d49202-dc97-44d6-bfc2-4d32992c01a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:37.944713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d49202-dc97-44d6-bfc2-4d32992c01a4 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:37.955483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 690/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:03:40.497181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5bd1c-93d3-44f0-a801-e9023afafc5c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.497795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5bd1c-93d3-44f0-a801-e9023afafc5c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.497795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5bd1c-93d3-44f0-a801-e9023afafc5c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.499533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 679/1369] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:40.505398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390007-79a6-4797-aa9a-271fa43684cc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.505958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390007-79a6-4797-aa9a-271fa43684cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.506056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b390007-79a6-4797-aa9a-271fa43684cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.526556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3b390007-79a6-4797-aa9a-271fa43684cc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:40.527841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3b390007-79a6-4797-aa9a-271fa43684cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:40.536344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 691/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:40.551944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d18b-57fc-402b-976e-f643a996f1fb None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.552228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d18b-57fc-402b-976e-f643a996f1fb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.552671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d18b-57fc-402b-976e-f643a996f1fb None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.554036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 680/1371] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:40.559396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf6cc3-daf7-47fb-a054-a8e7c3708513 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.559795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf6cc3-daf7-47fb-a054-a8e7c3708513 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.560195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf6cc3-daf7-47fb-a054-a8e7c3708513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.579216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a3cf6cc3-daf7-47fb-a054-a8e7c3708513 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:40.580405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a3cf6cc3-daf7-47fb-a054-a8e7c3708513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:40.581547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d18b-57fc-402b-976e-f643a996f1fb None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:40.589209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 692/1372] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:40.599344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d18b-57fc-402b-976e-f643a996f1fb None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:40.604890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2521a6e-c073-49b1-a794-e09143c36667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:40.605614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2521a6e-c073-49b1-a794-e09143c36667 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.605971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2521a6e-c073-49b1-a794-e09143c36667 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.606318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2521a6e-c073-49b1-a794-e09143c36667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.615443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2521a6e-c073-49b1-a794-e09143c36667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:40.617111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2521a6e-c073-49b1-a794-e09143c36667 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:40.627293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 681/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:40.868349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c489227-634a-4b24-a7c6-7e1cbcc5460a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.868644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c489227-634a-4b24-a7c6-7e1cbcc5460a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.869464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c489227-634a-4b24-a7c6-7e1cbcc5460a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.870900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 693/1374] 10.222.0.18 () {54 vars in 963 bytes} [Thu Jun 2 09:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:40.876481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe293-30ac-442a-b515-6fd3bb3ad370 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:40.877004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe293-30ac-442a-b515-6fd3bb3ad370 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:40.877479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe293-30ac-442a-b515-6fd3bb3ad370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:40.940683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-73dbe293-30ac-442a-b515-6fd3bb3ad370 None None] MFA Rules not processed for user `3e20e0dbc56e48299b586a3b33c0767d`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:40.942110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-73dbe293-30ac-442a-b515-6fd3bb3ad370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:41.014913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 682/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Jun 2 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:41.022728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c489227-634a-4b24-a7c6-7e1cbcc5460a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:41.035566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c489227-634a-4b24-a7c6-7e1cbcc5460a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:41.040025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e62a28-adff-4553-8eef-5e4edacda88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:41.040921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62a28-adff-4553-8eef-5e4edacda88c service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:41.041458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62a28-adff-4553-8eef-5e4edacda88c service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:41.041956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62a28-adff-4553-8eef-5e4edacda88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:41.052956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e62a28-adff-4553-8eef-5e4edacda88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:41.057311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e62a28-adff-4553-8eef-5e4edacda88c service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:41.066661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 694/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:43.068201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33705c-c5c5-4c2e-bbd3-5b8d90b85375 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:43.068721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33705c-c5c5-4c2e-bbd3-5b8d90b85375 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:43.068721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33705c-c5c5-4c2e-bbd3-5b8d90b85375 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:43.070203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 683/1377] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:43.076239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086d9e-c517-48ce-a188-1ac8b668e9ea None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:43.076769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086d9e-c517-48ce-a188-1ac8b668e9ea None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:43.076769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086d9e-c517-48ce-a188-1ac8b668e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:43.095331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-33086d9e-c517-48ce-a188-1ac8b668e9ea None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:43.096561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-33086d9e-c517-48ce-a188-1ac8b668e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:43.105206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 695/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:43.150561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33705c-c5c5-4c2e-bbd3-5b8d90b85375 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:43.166764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33705c-c5c5-4c2e-bbd3-5b8d90b85375 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:43.172274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc57084-a78c-47c6-ac65-45d0d4fde166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:43.172927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc57084-a78c-47c6-ac65-45d0d4fde166 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:43.173212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc57084-a78c-47c6-ac65-45d0d4fde166 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:43.173487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc57084-a78c-47c6-ac65-45d0d4fde166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:43.182128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc57084-a78c-47c6-ac65-45d0d4fde166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:43.183805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc57084-a78c-47c6-ac65-45d0d4fde166 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:43.193915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 684/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:45.594262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb0b9-1e41-40ca-abe2-0d5ad614d071 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:45.594826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb0b9-1e41-40ca-abe2-0d5ad614d071 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:45.594826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb0b9-1e41-40ca-abe2-0d5ad614d071 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:45.596396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 696/1380] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:45.601442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ddeb2-0ee1-4fd8-8c8e-66b65c410612 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:45.602219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ddeb2-0ee1-4fd8-8c8e-66b65c410612 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:45.602506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ddeb2-0ee1-4fd8-8c8e-66b65c410612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:45.621157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b64ddeb2-0ee1-4fd8-8c8e-66b65c410612 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:45.622598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b64ddeb2-0ee1-4fd8-8c8e-66b65c410612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:45.630827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 685/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:03:45.675167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb0b9-1e41-40ca-abe2-0d5ad614d071 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:45.689602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb0b9-1e41-40ca-abe2-0d5ad614d071 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:45.695125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f98c-0e46-4749-afd6-3390ca0eb490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:45.695809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f98c-0e46-4749-afd6-3390ca0eb490 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:45.696099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f98c-0e46-4749-afd6-3390ca0eb490 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:45.696382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f98c-0e46-4749-afd6-3390ca0eb490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:45.704622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3f98c-0e46-4749-afd6-3390ca0eb490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:45.706203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3f98c-0e46-4749-afd6-3390ca0eb490 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:45.716351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 697/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:48.144859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90455e-3608-4810-9e85-a22d39d9fbb7 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:48.145418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90455e-3608-4810-9e85-a22d39d9fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:48.145418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90455e-3608-4810-9e85-a22d39d9fbb7 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:48.146783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 686/1383] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:03:48.152296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcd50-75a2-4070-99dd-0891c3eec3e5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:48.152762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcd50-75a2-4070-99dd-0891c3eec3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:48.152856 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcd50-75a2-4070-99dd-0891c3eec3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:48.171914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e40dcd50-75a2-4070-99dd-0891c3eec3e5 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:48.173111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e40dcd50-75a2-4070-99dd-0891c3eec3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:48.189399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 698/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:48.222326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90455e-3608-4810-9e85-a22d39d9fbb7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:48.237676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90455e-3608-4810-9e85-a22d39d9fbb7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:48.243075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe05135-c703-459d-afed-aa5b61cbf17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:48.244623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05135-c703-459d-afed-aa5b61cbf17c service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:48.245004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05135-c703-459d-afed-aa5b61cbf17c service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:48.245392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05135-c703-459d-afed-aa5b61cbf17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:48.254270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05135-c703-459d-afed-aa5b61cbf17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:48.256083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe05135-c703-459d-afed-aa5b61cbf17c service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:48.266260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 687/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:03:51.327982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824e5d-3260-4d06-9adb-0944074ca11a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:51.328545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824e5d-3260-4d06-9adb-0944074ca11a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:51.328652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824e5d-3260-4d06-9adb-0944074ca11a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:51.331307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 699/1386] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:51.337076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4d7b-496a-4a58-967d-322fe4b80c53 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:51.338119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4d7b-496a-4a58-967d-322fe4b80c53 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:51.338271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4d7b-496a-4a58-967d-322fe4b80c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:51.356939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-150e4d7b-496a-4a58-967d-322fe4b80c53 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:51.358326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-150e4d7b-496a-4a58-967d-322fe4b80c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:51.366427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 688/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:51.412584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824e5d-3260-4d06-9adb-0944074ca11a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:51.436532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824e5d-3260-4d06-9adb-0944074ca11a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:51.443927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94228c81-4b0c-4c4d-a385-0f29d73a9f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:51.444602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94228c81-4b0c-4c4d-a385-0f29d73a9f60 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:51.444904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94228c81-4b0c-4c4d-a385-0f29d73a9f60 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:51.445185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94228c81-4b0c-4c4d-a385-0f29d73a9f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:51.457141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94228c81-4b0c-4c4d-a385-0f29d73a9f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:51.458834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94228c81-4b0c-4c4d-a385-0f29d73a9f60 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:51.468852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 700/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:54.474030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef541c-c54f-409e-b85a-82ccae95e38c None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:54.474592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef541c-c54f-409e-b85a-82ccae95e38c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:54.474748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef541c-c54f-409e-b85a-82ccae95e38c None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:54.476636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 689/1389] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:54.483550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688d76-d3eb-4a81-a320-f458ecda2a4d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:54.484007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688d76-d3eb-4a81-a320-f458ecda2a4d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:54.484103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688d76-d3eb-4a81-a320-f458ecda2a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:54.502081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0e688d76-d3eb-4a81-a320-f458ecda2a4d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:54.503331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0e688d76-d3eb-4a81-a320-f458ecda2a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:54.512010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 701/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:54.566558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef541c-c54f-409e-b85a-82ccae95e38c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:54.582778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef541c-c54f-409e-b85a-82ccae95e38c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:54.589239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b340dc7-6238-43a9-834a-b24baee6aac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:54.589887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b340dc7-6238-43a9-834a-b24baee6aac1 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:54.590179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b340dc7-6238-43a9-834a-b24baee6aac1 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:54.590471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b340dc7-6238-43a9-834a-b24baee6aac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:54.598925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b340dc7-6238-43a9-834a-b24baee6aac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:54.600548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b340dc7-6238-43a9-834a-b24baee6aac1 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:54.610588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 690/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:57.106766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc0d8-d2c3-4c33-831a-9136bde2d600 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.107381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc0d8-d2c3-4c33-831a-9136bde2d600 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.107381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc0d8-d2c3-4c33-831a-9136bde2d600 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.108726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 702/1392] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:57.113966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582286-c3f6-489b-8680-ffcf22c14ec6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.114389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582286-c3f6-489b-8680-ffcf22c14ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.114532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e582286-c3f6-489b-8680-ffcf22c14ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.132354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6e582286-c3f6-489b-8680-ffcf22c14ec6 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:57.133558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6e582286-c3f6-489b-8680-ffcf22c14ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:57.142479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 691/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:03:57.186209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc0d8-d2c3-4c33-831a-9136bde2d600 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:57.194268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=49 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:57.201291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc0d8-d2c3-4c33-831a-9136bde2d600 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:57.206672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59b17-bf6a-4909-b6d7-06a3f4e5e90f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:57.207371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59b17-bf6a-4909-b6d7-06a3f4e5e90f service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.207658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59b17-bf6a-4909-b6d7-06a3f4e5e90f service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.207929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59b17-bf6a-4909-b6d7-06a3f4e5e90f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.216920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59b17-bf6a-4909-b6d7-06a3f4e5e90f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:57.218497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b59b17-bf6a-4909-b6d7-06a3f4e5e90f service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:57.228896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 703/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:57.238407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805954e5-21e0-4462-87c9-d5f236021110 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.238700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805954e5-21e0-4462-87c9-d5f236021110 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.238983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805954e5-21e0-4462-87c9-d5f236021110 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.240380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 692/1395] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:57.245835 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbe39-199e-4969-a36c-6da8cda1ca39 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.250263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbe39-199e-4969-a36c-6da8cda1ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.250263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbe39-199e-4969-a36c-6da8cda1ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.264436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a2dfbe39-199e-4969-a36c-6da8cda1ca39 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:57.265610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a2dfbe39-199e-4969-a36c-6da8cda1ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:57.273447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 704/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:57.328871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbeefc-4289-4cb5-9a1c-48faaccb2e11 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.329241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbeefc-4289-4cb5-9a1c-48faaccb2e11 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.329517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbeefc-4289-4cb5-9a1c-48faaccb2e11 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.330866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 693/1397] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jun 2 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:57.336060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357634a9-8690-4818-9a69-371b8d3d8830 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.336352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357634a9-8690-4818-9a69-371b8d3d8830 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.336637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357634a9-8690-4818-9a69-371b8d3d8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.384911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-357634a9-8690-4818-9a69-371b8d3d8830 None None] MFA Rules not processed for user `4091c55281ef4eeb8f2c4e9d84b2fe1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:57.386377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-357634a9-8690-4818-9a69-371b8d3d8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:57.452181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 705/1398] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jun 2 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:57.459903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbeefc-4289-4cb5-9a1c-48faaccb2e11 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:57.470957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbeefc-4289-4cb5-9a1c-48faaccb2e11 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:57.474619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab7de9-cefa-422b-b025-b633be913a37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:57.475315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab7de9-cefa-422b-b025-b633be913a37 service glance] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:57.475609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab7de9-cefa-422b-b025-b633be913a37 service glance] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:57.475880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab7de9-cefa-422b-b025-b633be913a37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:57.486967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:57.489725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab7de9-cefa-422b-b025-b633be913a37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:57.491624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab7de9-cefa-422b-b025-b633be913a37 service glance] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:57.503110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 694/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:03:58.227591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d160-613c-4574-b901-61b2ced021cd None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:58.228654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d160-613c-4574-b901-61b2ced021cd None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:58.231363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d160-613c-4574-b901-61b2ced021cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:58.277531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-dd94d160-613c-4574-b901-61b2ced021cd None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:58.278812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-dd94d160-613c-4574-b901-61b2ced021cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:58.342863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 706/1400] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:58.383491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4fa6d-9819-4796-a6ba-6d91366a7925 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:58.383983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4fa6d-9819-4796-a6ba-6d91366a7925 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:58.384085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4fa6d-9819-4796-a6ba-6d91366a7925 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:58.385415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 695/1401] 10.222.0.18 () {54 vars in 942 bytes} [Thu Jun 2 09:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:58.391990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f50cd2-1a27-41e8-8db9-a8bc947ce455 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:58.392278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f50cd2-1a27-41e8-8db9-a8bc947ce455 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:58.392554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f50cd2-1a27-41e8-8db9-a8bc947ce455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:58.437382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:58.440872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c1f50cd2-1a27-41e8-8db9-a8bc947ce455 None None] MFA Rules not processed for user `35b1d5f68be34afc8a72843e869bc3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:58.442395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c1f50cd2-1a27-41e8-8db9-a8bc947ce455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:58.516755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 707/1402] 10.222.0.18 () {58 vars in 1039 bytes} [Thu Jun 2 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:58.526376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4fa6d-9819-4796-a6ba-6d91366a7925 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:58.539612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4fa6d-9819-4796-a6ba-6d91366a7925 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:58.544568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193e905-166a-435d-a95b-c6dd703b3839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:58.545204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e905-166a-435d-a95b-c6dd703b3839 service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:58.545491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e905-166a-435d-a95b-c6dd703b3839 service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:58.545769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e905-166a-435d-a95b-c6dd703b3839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:58.553896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193e905-166a-435d-a95b-c6dd703b3839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:58.555509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193e905-166a-435d-a95b-c6dd703b3839 service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:58.563546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 696/1403] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:03:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:03:59.619414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db2d2f-a5ec-4052-85f1-f71904bcfd2f None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:59.619959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db2d2f-a5ec-4052-85f1-f71904bcfd2f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:59.619959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db2d2f-a5ec-4052-85f1-f71904bcfd2f None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:59.621354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 708/1404] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:03:59.626723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e4d2c-af22-479b-a214-799b274f7cb2 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:59.627147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e4d2c-af22-479b-a214-799b274f7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:59.627334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e4d2c-af22-479b-a214-799b274f7cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:59.647414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-548e4d2c-af22-479b-a214-799b274f7cb2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:03:59.648631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-548e4d2c-af22-479b-a214-799b274f7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:03:59.657194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 697/1405] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:03:59.702348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db2d2f-a5ec-4052-85f1-f71904bcfd2f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:03:59.719349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db2d2f-a5ec-4052-85f1-f71904bcfd2f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:03:59.727724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d867-b03b-4d13-be06-044a04784a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:03:59.729068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d867-b03b-4d13-be06-044a04784a80 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:03:59.729359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d867-b03b-4d13-be06-044a04784a80 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:03:59.729697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d867-b03b-4d13-be06-044a04784a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:03:59.738664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49d867-b03b-4d13-be06-044a04784a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:03:59.740319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49d867-b03b-4d13-be06-044a04784a80 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:03:59.750457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 709/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:02.308332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9518b-0050-49e5-b62f-4eca656096c7 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:02.308845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9518b-0050-49e5-b62f-4eca656096c7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:02.308845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9518b-0050-49e5-b62f-4eca656096c7 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:02.310235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 698/1407] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:02.315534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bc773-a2f9-4c1a-b05a-7c4bba227ad5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:02.315964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bc773-a2f9-4c1a-b05a-7c4bba227ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:02.318292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bc773-a2f9-4c1a-b05a-7c4bba227ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:02.334961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-dd3bc773-a2f9-4c1a-b05a-7c4bba227ad5 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:02.341326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-dd3bc773-a2f9-4c1a-b05a-7c4bba227ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:02.344058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 710/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:04:02.389620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9518b-0050-49e5-b62f-4eca656096c7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:02.406231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9518b-0050-49e5-b62f-4eca656096c7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:02.411837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca155c-5c2e-42bf-9603-b8301834ff7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:02.412467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca155c-5c2e-42bf-9603-b8301834ff7a service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:02.412812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca155c-5c2e-42bf-9603-b8301834ff7a service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:02.413091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca155c-5c2e-42bf-9603-b8301834ff7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:02.422360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca155c-5c2e-42bf-9603-b8301834ff7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:02.424063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca155c-5c2e-42bf-9603-b8301834ff7a service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:02.434996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 699/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:12.328513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=39 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:04:12.429403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=17 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:04:23.037415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03a6f-3648-48b6-b577-7ca1b336cf75 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:23.037971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03a6f-3648-48b6-b577-7ca1b336cf75 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:23.038077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03a6f-3648-48b6-b577-7ca1b336cf75 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:23.039624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 711/1410] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jun 2 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:23.044505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ff70-a6f5-4845-9bb9-ffbf7ae0c5a3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:23.044908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ff70-a6f5-4845-9bb9-ffbf7ae0c5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:23.045060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ff70-a6f5-4845-9bb9-ffbf7ae0c5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:23.064311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-edf5ff70-a6f5-4845-9bb9-ffbf7ae0c5a3 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:23.065517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-edf5ff70-a6f5-4845-9bb9-ffbf7ae0c5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:23.074681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 700/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jun 2 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:23.088853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201a619-2b03-4d75-b6de-cb5dd3f548cc None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:23.089208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201a619-2b03-4d75-b6de-cb5dd3f548cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:23.089493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201a619-2b03-4d75-b6de-cb5dd3f548cc None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:23.090844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 712/1412] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jun 2 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:23.095406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e859-27f7-4fd8-bad6-4b395f40c763 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:23.095699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e859-27f7-4fd8-bad6-4b395f40c763 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:23.095976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e859-27f7-4fd8-bad6-4b395f40c763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:23.114412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2288e859-27f7-4fd8-bad6-4b395f40c763 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:23.115633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2288e859-27f7-4fd8-bad6-4b395f40c763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:23.125110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 701/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jun 2 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:25.864192 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3c574-1c13-4e70-9613-e2b70360c219 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:25.864659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3c574-1c13-4e70-9613-e2b70360c219 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:25.864776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3c574-1c13-4e70-9613-e2b70360c219 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:25.866161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:25.874144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecdcf7-208c-459a-8ced-be11651e314c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:25.874785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecdcf7-208c-459a-8ced-be11651e314c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:25.875074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecdcf7-208c-459a-8ced-be11651e314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:25.894872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-69ecdcf7-208c-459a-8ced-be11651e314c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:25.896086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-69ecdcf7-208c-459a-8ced-be11651e314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:25.904403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:25.947401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3c574-1c13-4e70-9613-e2b70360c219 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:25.961735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3c574-1c13-4e70-9613-e2b70360c219 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:25.970291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1646-f425-445a-8fb4-efdeba1e7dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:25.971309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1646-f425-445a-8fb4-efdeba1e7dec service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:25.971812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1646-f425-445a-8fb4-efdeba1e7dec service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:25.972288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1646-f425-445a-8fb4-efdeba1e7dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:25.981401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1646-f425-445a-8fb4-efdeba1e7dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:25.982983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1646-f425-445a-8fb4-efdeba1e7dec service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:25.992188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 714/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:26.965794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0395-5938-4325-af8c-8b0d882de043 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:26.966255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0395-5938-4325-af8c-8b0d882de043 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:26.966358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0395-5938-4325-af8c-8b0d882de043 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:26.967847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:26.972652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128f35-af26-4649-8290-a5787c7c30cc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:26.973089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128f35-af26-4649-8290-a5787c7c30cc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:26.973214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128f35-af26-4649-8290-a5787c7c30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:26.992881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-76128f35-af26-4649-8290-a5787c7c30cc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:26.994087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-76128f35-af26-4649-8290-a5787c7c30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:27.001884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:27.161960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0395-5938-4325-af8c-8b0d882de043 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:27.176058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0395-5938-4325-af8c-8b0d882de043 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:27.181675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19da9-b46b-4fff-9131-b47f9de8d025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:27.182250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19da9-b46b-4fff-9131-b47f9de8d025 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:27.182528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19da9-b46b-4fff-9131-b47f9de8d025 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:27.182820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19da9-b46b-4fff-9131-b47f9de8d025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:27.190757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19da9-b46b-4fff-9131-b47f9de8d025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:27.192352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19da9-b46b-4fff-9131-b47f9de8d025 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:27.202103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 704/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:28.125468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f9a23-0d2e-4d06-93c6-6537b152476c None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:28.126046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f9a23-0d2e-4d06-93c6-6537b152476c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:28.126046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f9a23-0d2e-4d06-93c6-6537b152476c None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:28.127443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:28.132432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e88c86-5978-49f4-9f67-67fbcd27d284 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:28.132815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e88c86-5978-49f4-9f67-67fbcd27d284 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:28.132995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e88c86-5978-49f4-9f67-67fbcd27d284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:28.151438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-48e88c86-5978-49f4-9f67-67fbcd27d284 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:28.152635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-48e88c86-5978-49f4-9f67-67fbcd27d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:28.160411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:28.308236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f9a23-0d2e-4d06-93c6-6537b152476c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:28.322930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f9a23-0d2e-4d06-93c6-6537b152476c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:28.328364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92870-1298-4022-a071-b49905273e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:28.328990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92870-1298-4022-a071-b49905273e56 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:28.329272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92870-1298-4022-a071-b49905273e56 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:28.329547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92870-1298-4022-a071-b49905273e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:28.337650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92870-1298-4022-a071-b49905273e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:28.339212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92870-1298-4022-a071-b49905273e56 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:28.348516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 717/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:29.244821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7993cfa-f46e-4f2e-99d8-1c3bef1ea77a None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:29.245332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7993cfa-f46e-4f2e-99d8-1c3bef1ea77a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:29.245332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7993cfa-f46e-4f2e-99d8-1c3bef1ea77a None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:29.246636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:29.251690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20787b2-e43c-4920-bb38-099f97b728b4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:29.252168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20787b2-e43c-4920-bb38-099f97b728b4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:29.252280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20787b2-e43c-4920-bb38-099f97b728b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:29.270505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d20787b2-e43c-4920-bb38-099f97b728b4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:29.271716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d20787b2-e43c-4920-bb38-099f97b728b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:29.279953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:29.426554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7993cfa-f46e-4f2e-99d8-1c3bef1ea77a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:29.440717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7993cfa-f46e-4f2e-99d8-1c3bef1ea77a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:29.446541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c2b0-3dc6-4fb0-9666-da537a4bb5ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:29.447173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c2b0-3dc6-4fb0-9666-da537a4bb5ec service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:29.447485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c2b0-3dc6-4fb0-9666-da537a4bb5ec service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:29.447762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c2b0-3dc6-4fb0-9666-da537a4bb5ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:29.455718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c2b0-3dc6-4fb0-9666-da537a4bb5ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:29.457284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c2b0-3dc6-4fb0-9666-da537a4bb5ec service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:29.467102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 707/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:30.364732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6daa4-1ae7-4d70-91f8-5e3e0db05eb7 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:30.365303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6daa4-1ae7-4d70-91f8-5e3e0db05eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:30.365303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6daa4-1ae7-4d70-91f8-5e3e0db05eb7 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:30.366638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:30.372321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddb20d-bdca-431e-9717-b5b628660b81 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:30.372752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddb20d-bdca-431e-9717-b5b628660b81 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:30.372867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddb20d-bdca-431e-9717-b5b628660b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:30.390807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-eaddb20d-bdca-431e-9717-b5b628660b81 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:30.392042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-eaddb20d-bdca-431e-9717-b5b628660b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:30.400298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:30.549559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6daa4-1ae7-4d70-91f8-5e3e0db05eb7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:30.563737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6daa4-1ae7-4d70-91f8-5e3e0db05eb7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:30.569055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d4ec-b588-414b-9c04-0d9bc93312c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:30.569684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d4ec-b588-414b-9c04-0d9bc93312c5 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:30.569979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d4ec-b588-414b-9c04-0d9bc93312c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:30.570233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d4ec-b588-414b-9c04-0d9bc93312c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:30.578083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d4ec-b588-414b-9c04-0d9bc93312c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:30.579993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d4ec-b588-414b-9c04-0d9bc93312c5 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:30.589344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 720/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:31.490047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76682-4624-4f58-b9bd-6b4867ad922a None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:31.490586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76682-4624-4f58-b9bd-6b4867ad922a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:31.490586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76682-4624-4f58-b9bd-6b4867ad922a None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:31.492018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:31.497411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46220-eb28-4cfa-91fd-9f059b4466c5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:31.497810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46220-eb28-4cfa-91fd-9f059b4466c5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:31.498006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46220-eb28-4cfa-91fd-9f059b4466c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:31.516661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9ef46220-eb28-4cfa-91fd-9f059b4466c5 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:31.517845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9ef46220-eb28-4cfa-91fd-9f059b4466c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:31.525573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:31.675453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76682-4624-4f58-b9bd-6b4867ad922a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:31.690418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76682-4624-4f58-b9bd-6b4867ad922a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:31.695805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f87b8-9f99-424b-a3f2-a06adb7f45d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:31.696443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f87b8-9f99-424b-a3f2-a06adb7f45d9 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:31.696730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f87b8-9f99-424b-a3f2-a06adb7f45d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:31.697010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f87b8-9f99-424b-a3f2-a06adb7f45d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:31.705029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f87b8-9f99-424b-a3f2-a06adb7f45d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:31.706610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f87b8-9f99-424b-a3f2-a06adb7f45d9 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:31.716000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 710/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:32.655754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53c2a2-ed3d-4d8c-8c1d-adb0dc9bc763 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:32.656284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53c2a2-ed3d-4d8c-8c1d-adb0dc9bc763 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:32.656399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53c2a2-ed3d-4d8c-8c1d-adb0dc9bc763 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:32.657687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:32.662655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841230f-85f8-4317-82e2-b1e12b3e20c7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:32.663089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841230f-85f8-4317-82e2-b1e12b3e20c7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:32.663194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841230f-85f8-4317-82e2-b1e12b3e20c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:32.681585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b841230f-85f8-4317-82e2-b1e12b3e20c7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:32.682764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b841230f-85f8-4317-82e2-b1e12b3e20c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:32.690454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:32.838425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53c2a2-ed3d-4d8c-8c1d-adb0dc9bc763 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:32.853156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53c2a2-ed3d-4d8c-8c1d-adb0dc9bc763 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:32.858583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc27eb1-9fdd-43f7-9f7c-970602fc3fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:32.859198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27eb1-9fdd-43f7-9f7c-970602fc3fb7 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:32.859513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27eb1-9fdd-43f7-9f7c-970602fc3fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:32.859792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc27eb1-9fdd-43f7-9f7c-970602fc3fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:32.868085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc27eb1-9fdd-43f7-9f7c-970602fc3fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:32.869673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc27eb1-9fdd-43f7-9f7c-970602fc3fb7 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:32.879182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 723/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:33.833197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728207cf-0c98-44ac-929f-632f9015fa1f None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:33.833734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728207cf-0c98-44ac-929f-632f9015fa1f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:33.833734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728207cf-0c98-44ac-929f-632f9015fa1f None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:33.835122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:33.840534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90de6-7581-4176-8d9c-cabcbc04581f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:33.840949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90de6-7581-4176-8d9c-cabcbc04581f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:33.841087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90de6-7581-4176-8d9c-cabcbc04581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:33.858471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9bc90de6-7581-4176-8d9c-cabcbc04581f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:33.859804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9bc90de6-7581-4176-8d9c-cabcbc04581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:33.867457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:34.019080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728207cf-0c98-44ac-929f-632f9015fa1f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:34.033715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728207cf-0c98-44ac-929f-632f9015fa1f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:34.038938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eabad1-85d6-4815-bfe7-87da47e8cb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:34.039596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eabad1-85d6-4815-bfe7-87da47e8cb03 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:34.039877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eabad1-85d6-4815-bfe7-87da47e8cb03 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:34.040187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eabad1-85d6-4815-bfe7-87da47e8cb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:34.048095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eabad1-85d6-4815-bfe7-87da47e8cb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:34.051270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eabad1-85d6-4815-bfe7-87da47e8cb03 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:34.058781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 713/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:34.996786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463234-08e2-4135-adf5-74dbf623f8bc None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:34.997297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463234-08e2-4135-adf5-74dbf623f8bc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:34.997392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463234-08e2-4135-adf5-74dbf623f8bc None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:34.998770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:35.003625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88caf-270c-47ff-b18b-cec416eb5f1b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:35.004134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88caf-270c-47ff-b18b-cec416eb5f1b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:35.004234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f88caf-270c-47ff-b18b-cec416eb5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:35.022340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-02f88caf-270c-47ff-b18b-cec416eb5f1b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:35.024107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-02f88caf-270c-47ff-b18b-cec416eb5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:35.031830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:35.180581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb463234-08e2-4135-adf5-74dbf623f8bc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:35.194382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb463234-08e2-4135-adf5-74dbf623f8bc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:35.199723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed657e-42f4-4f54-81ae-1cedf5b79fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:35.200380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed657e-42f4-4f54-81ae-1cedf5b79fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:35.200663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed657e-42f4-4f54-81ae-1cedf5b79fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:35.200934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed657e-42f4-4f54-81ae-1cedf5b79fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:35.208786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed657e-42f4-4f54-81ae-1cedf5b79fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:35.210336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed657e-42f4-4f54-81ae-1cedf5b79fe8 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:35.220114 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 726/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:37.337739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae189e0-2bb9-4612-a1a0-fc1af888cc4a None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:37.338261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae189e0-2bb9-4612-a1a0-fc1af888cc4a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:37.338261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae189e0-2bb9-4612-a1a0-fc1af888cc4a None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:37.339688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:37.344834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fcf22-7bdc-4e51-b2b2-adf1bbb73322 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:37.345281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fcf22-7bdc-4e51-b2b2-adf1bbb73322 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:37.345421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fcf22-7bdc-4e51-b2b2-adf1bbb73322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:37.362829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8d3fcf22-7bdc-4e51-b2b2-adf1bbb73322 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:37.364346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d3fcf22-7bdc-4e51-b2b2-adf1bbb73322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:37.372548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:37.411212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae189e0-2bb9-4612-a1a0-fc1af888cc4a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:37.412916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3ae189e0-2bb9-4612-a1a0-fc1af888cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:37.425665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae189e0-2bb9-4612-a1a0-fc1af888cc4a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:37.429123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59ac94-35fd-4ecc-a4f2-d26967affbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:37.430307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59ac94-35fd-4ecc-a4f2-d26967affbba service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:37.430589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59ac94-35fd-4ecc-a4f2-d26967affbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:37.430864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59ac94-35fd-4ecc-a4f2-d26967affbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:37.439715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59ac94-35fd-4ecc-a4f2-d26967affbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:37.441122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59ac94-35fd-4ecc-a4f2-d26967affbba service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:37.450953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 716/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:39.846384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76c95-1b33-404d-a169-984b8348eb3a None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:39.846923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76c95-1b33-404d-a169-984b8348eb3a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:39.846923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76c95-1b33-404d-a169-984b8348eb3a None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:39.848367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:39.854075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f68a83-00a2-458f-b481-90215461e852 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:39.854477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f68a83-00a2-458f-b481-90215461e852 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:39.854637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f68a83-00a2-458f-b481-90215461e852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:39.873363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f9f68a83-00a2-458f-b481-90215461e852 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:39.875488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f9f68a83-00a2-458f-b481-90215461e852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:39.885518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:39.924937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76c95-1b33-404d-a169-984b8348eb3a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:39.936770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76c95-1b33-404d-a169-984b8348eb3a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:39.940415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc630ff-c68a-4e35-a031-0a69110f843d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:39.941134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc630ff-c68a-4e35-a031-0a69110f843d service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:39.941592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc630ff-c68a-4e35-a031-0a69110f843d service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:39.941868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc630ff-c68a-4e35-a031-0a69110f843d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:39.951770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc630ff-c68a-4e35-a031-0a69110f843d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:39.953493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc630ff-c68a-4e35-a031-0a69110f843d service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:39.967478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 729/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:42.577357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cd196-4589-4a9b-8766-e01f87e47ad4 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:42.577949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cd196-4589-4a9b-8766-e01f87e47ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:42.577949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cd196-4589-4a9b-8766-e01f87e47ad4 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:42.579219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:42.584450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47007324-a976-44b4-be2c-619d20f34dfa None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:42.584905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47007324-a976-44b4-be2c-619d20f34dfa None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:42.585012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47007324-a976-44b4-be2c-619d20f34dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:42.602296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-47007324-a976-44b4-be2c-619d20f34dfa None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:42.603516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-47007324-a976-44b4-be2c-619d20f34dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:42.611662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:42.651072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cd196-4589-4a9b-8766-e01f87e47ad4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:42.661653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cd196-4589-4a9b-8766-e01f87e47ad4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:42.665190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e550b-3941-4597-979e-966998a51975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:42.665810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e550b-3941-4597-979e-966998a51975 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:42.666096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e550b-3941-4597-979e-966998a51975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:42.666373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e550b-3941-4597-979e-966998a51975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:42.675036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e550b-3941-4597-979e-966998a51975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:42.676502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e550b-3941-4597-979e-966998a51975 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:42.686259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 719/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:45.041946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800068c1-2ca1-4a63-9d53-ef1ced5b1b58 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:45.042488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800068c1-2ca1-4a63-9d53-ef1ced5b1b58 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:45.042488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800068c1-2ca1-4a63-9d53-ef1ced5b1b58 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:45.043923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:45.049287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b852bf-3aa4-477e-af44-2cc2bde601f9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:45.049694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b852bf-3aa4-477e-af44-2cc2bde601f9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:45.049867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b852bf-3aa4-477e-af44-2cc2bde601f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:45.067383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-13b852bf-3aa4-477e-af44-2cc2bde601f9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:45.068571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-13b852bf-3aa4-477e-af44-2cc2bde601f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:45.076770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:45.115035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800068c1-2ca1-4a63-9d53-ef1ced5b1b58 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:45.125641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800068c1-2ca1-4a63-9d53-ef1ced5b1b58 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:45.129292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102be84-a750-4bda-9da4-a623ebacd910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:45.129950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102be84-a750-4bda-9da4-a623ebacd910 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:45.130239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102be84-a750-4bda-9da4-a623ebacd910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:45.130518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102be84-a750-4bda-9da4-a623ebacd910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:45.140109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102be84-a750-4bda-9da4-a623ebacd910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:45.141537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102be84-a750-4bda-9da4-a623ebacd910 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:45.151480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 732/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:47.439991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925cbc5-1673-4787-bb62-0105bb9d4567 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:47.440572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925cbc5-1673-4787-bb62-0105bb9d4567 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:47.440572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925cbc5-1673-4787-bb62-0105bb9d4567 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:47.441939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:47.447276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb257ff-3e8b-4a97-89ff-559e972cb11c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:47.447713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb257ff-3e8b-4a97-89ff-559e972cb11c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:47.447827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb257ff-3e8b-4a97-89ff-559e972cb11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:47.465429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9cb257ff-3e8b-4a97-89ff-559e972cb11c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:47.466613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9cb257ff-3e8b-4a97-89ff-559e972cb11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:47.474304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:47.513055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925cbc5-1673-4787-bb62-0105bb9d4567 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:47.523839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925cbc5-1673-4787-bb62-0105bb9d4567 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:47.527333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e6c9-0a2c-44fe-bc26-62c30e1323bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:47.527974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e6c9-0a2c-44fe-bc26-62c30e1323bb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:47.528258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e6c9-0a2c-44fe-bc26-62c30e1323bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:47.528537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e6c9-0a2c-44fe-bc26-62c30e1323bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:47.537622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46e6c9-0a2c-44fe-bc26-62c30e1323bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:47.539601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46e6c9-0a2c-44fe-bc26-62c30e1323bb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:47.548872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 722/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:49.838156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ed03a-d8f1-44e0-95fa-e8b3ed64bcee None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:49.838743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ed03a-d8f1-44e0-95fa-e8b3ed64bcee None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:49.838743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ed03a-d8f1-44e0-95fa-e8b3ed64bcee None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:49.840112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:49.845408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe2f6-902e-49e6-aa99-c11eb310a06a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:49.845840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe2f6-902e-49e6-aa99-c11eb310a06a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:49.845955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe2f6-902e-49e6-aa99-c11eb310a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:49.863948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ef2fe2f6-902e-49e6-aa99-c11eb310a06a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:49.865144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ef2fe2f6-902e-49e6-aa99-c11eb310a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:49.873604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:49.911455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ed03a-d8f1-44e0-95fa-e8b3ed64bcee None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:49.925715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ed03a-d8f1-44e0-95fa-e8b3ed64bcee None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:49.929378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05729efe-18dc-480f-8d34-2b5d0556c6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:49.930020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729efe-18dc-480f-8d34-2b5d0556c6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:49.930310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729efe-18dc-480f-8d34-2b5d0556c6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:49.930587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729efe-18dc-480f-8d34-2b5d0556c6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:49.939916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05729efe-18dc-480f-8d34-2b5d0556c6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:49.941346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05729efe-18dc-480f-8d34-2b5d0556c6e5 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:49.950599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 735/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:52.251532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4915b5-d7d3-4a63-b8d0-dde83a5151e7 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:52.252133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4915b5-d7d3-4a63-b8d0-dde83a5151e7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:52.252133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4915b5-d7d3-4a63-b8d0-dde83a5151e7 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:52.253435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:52.259414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc560c-66c4-48ca-8f1a-ec08de6934bc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:52.259862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc560c-66c4-48ca-8f1a-ec08de6934bc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:52.259981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc560c-66c4-48ca-8f1a-ec08de6934bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:52.277957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1bcc560c-66c4-48ca-8f1a-ec08de6934bc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:52.279145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1bcc560c-66c4-48ca-8f1a-ec08de6934bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:52.287369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:52.330824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4915b5-d7d3-4a63-b8d0-dde83a5151e7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:52.342412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4915b5-d7d3-4a63-b8d0-dde83a5151e7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:52.345977 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6069ef-df55-4159-a1ba-edee2d2121a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:52.346612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6069ef-df55-4159-a1ba-edee2d2121a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:52.346899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6069ef-df55-4159-a1ba-edee2d2121a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:52.347175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6069ef-df55-4159-a1ba-edee2d2121a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:52.358505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6069ef-df55-4159-a1ba-edee2d2121a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:52.359960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6069ef-df55-4159-a1ba-edee2d2121a5 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:52.370046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 725/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:54.667164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30cd5c-9bca-48f3-8210-c99e5065f303 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:54.667797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30cd5c-9bca-48f3-8210-c99e5065f303 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:54.667797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30cd5c-9bca-48f3-8210-c99e5065f303 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:54.669137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:54.674465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9173-6614-4851-8987-1eff54264657 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:54.674866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9173-6614-4851-8987-1eff54264657 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:54.675029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9173-6614-4851-8987-1eff54264657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:54.681836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=79 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:04:54.693577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7b0a9173-6614-4851-8987-1eff54264657 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:54.697195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7b0a9173-6614-4851-8987-1eff54264657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:54.703285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:54.740023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30cd5c-9bca-48f3-8210-c99e5065f303 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:54.745983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=73 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:04:54.751662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30cd5c-9bca-48f3-8210-c99e5065f303 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:54.755205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da3d6-749a-4ff8-bbaf-65c94e103545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:54.755861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da3d6-749a-4ff8-bbaf-65c94e103545 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:54.756144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da3d6-749a-4ff8-bbaf-65c94e103545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:54.756419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da3d6-749a-4ff8-bbaf-65c94e103545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:54.766061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700da3d6-749a-4ff8-bbaf-65c94e103545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:54.767512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700da3d6-749a-4ff8-bbaf-65c94e103545 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:54.777060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 738/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:57.029174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b55cc-77cf-4d45-be21-c9ac9929923d None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:57.029756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b55cc-77cf-4d45-be21-c9ac9929923d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:57.029756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b55cc-77cf-4d45-be21-c9ac9929923d None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:57.031143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:57.036578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5979d4-aa1a-41e8-a5db-a49397eb736e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:57.037362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5979d4-aa1a-41e8-a5db-a49397eb736e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:57.037643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5979d4-aa1a-41e8-a5db-a49397eb736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:57.056039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4e5979d4-aa1a-41e8-a5db-a49397eb736e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:57.057215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4e5979d4-aa1a-41e8-a5db-a49397eb736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:57.064829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:57.100523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b55cc-77cf-4d45-be21-c9ac9929923d None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:57.111563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b55cc-77cf-4d45-be21-c9ac9929923d None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:57.115055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f267bd3-e653-4ad6-b3b7-b28b8bb7f9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:57.115727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267bd3-e653-4ad6-b3b7-b28b8bb7f9fb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:57.116016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267bd3-e653-4ad6-b3b7-b28b8bb7f9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:57.116293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267bd3-e653-4ad6-b3b7-b28b8bb7f9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:57.125693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f267bd3-e653-4ad6-b3b7-b28b8bb7f9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:57.127117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f267bd3-e653-4ad6-b3b7-b28b8bb7f9fb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:57.136677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 728/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:59.370978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b08d6-1a3d-4c89-ac3f-176f8d7fe827 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:59.371534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b08d6-1a3d-4c89-ac3f-176f8d7fe827 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:59.371534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b08d6-1a3d-4c89-ac3f-176f8d7fe827 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:59.372842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:04:59.378212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d62cf-c4f1-4008-be67-8d9615e06bba None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:59.378729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d62cf-c4f1-4008-be67-8d9615e06bba None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:59.378838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d62cf-c4f1-4008-be67-8d9615e06bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:59.396845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-de4d62cf-c4f1-4008-be67-8d9615e06bba None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:04:59.398670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-de4d62cf-c4f1-4008-be67-8d9615e06bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:04:59.406258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:04:59.441975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b08d6-1a3d-4c89-ac3f-176f8d7fe827 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:04:59.452978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b08d6-1a3d-4c89-ac3f-176f8d7fe827 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:04:59.456427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6f9ec-4054-4b39-af5d-5f6f20770f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:04:59.457061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f9ec-4054-4b39-af5d-5f6f20770f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:04:59.457349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f9ec-4054-4b39-af5d-5f6f20770f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:04:59.457635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f9ec-4054-4b39-af5d-5f6f20770f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:04:59.467012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f9ec-4054-4b39-af5d-5f6f20770f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:04:59.468483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f9ec-4054-4b39-af5d-5f6f20770f98 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:04:59.477735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 741/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:05:09.391732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=11 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:05:09.473644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=14 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:05:31.275627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db39bd-a64e-406b-b401-e1f9fe737187 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:31.276181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db39bd-a64e-406b-b401-e1f9fe737187 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:31.276181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db39bd-a64e-406b-b401-e1f9fe737187 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:31.277479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 730/1471] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:31.282663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d458ba-28be-4a59-bd76-fa389e67f4f3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:31.283073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d458ba-28be-4a59-bd76-fa389e67f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:31.283224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d458ba-28be-4a59-bd76-fa389e67f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:31.300681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-33d458ba-28be-4a59-bd76-fa389e67f4f3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:31.301872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-33d458ba-28be-4a59-bd76-fa389e67f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:31.310214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 742/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:05:31.356165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7621-6d6e-4785-b856-943fae315fc9 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:31.356452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7621-6d6e-4785-b856-943fae315fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:31.356727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7621-6d6e-4785-b856-943fae315fc9 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:31.358082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 731/1473] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jun 2 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:31.362852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6681231-7719-4342-892e-6c98ed3c4632 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:31.363141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6681231-7719-4342-892e-6c98ed3c4632 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:31.363449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6681231-7719-4342-892e-6c98ed3c4632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:31.381916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d6681231-7719-4342-892e-6c98ed3c4632 None None] MFA Rules not processed for user `4091c55281ef4eeb8f2c4e9d84b2fe1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:31.383072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d6681231-7719-4342-892e-6c98ed3c4632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:31.389648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 743/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jun 2 09:05:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:05:31.396442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7621-6d6e-4785-b856-943fae315fc9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:31.406971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7621-6d6e-4785-b856-943fae315fc9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:31.410474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e4d7-1f7f-4df1-beb3-1262a73566bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:31.411102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e4d7-1f7f-4df1-beb3-1262a73566bb service glance] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:31.411417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e4d7-1f7f-4df1-beb3-1262a73566bb service glance] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:31.411694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e4d7-1f7f-4df1-beb3-1262a73566bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:31.420553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1e4d7-1f7f-4df1-beb3-1262a73566bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:31.421969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1e4d7-1f7f-4df1-beb3-1262a73566bb service glance] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:31.431892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 732/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:05:33.746234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097ddf-80d1-4757-8eaf-2feadfa3bc72 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:33.746782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097ddf-80d1-4757-8eaf-2feadfa3bc72 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:33.746888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097ddf-80d1-4757-8eaf-2feadfa3bc72 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:33.748342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 744/1476] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:33.753628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64a42-d6fa-4147-ab8c-a3e7f210b7b7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:33.754057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64a42-d6fa-4147-ab8c-a3e7f210b7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:33.754191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64a42-d6fa-4147-ab8c-a3e7f210b7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:33.773111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d2b64a42-d6fa-4147-ab8c-a3e7f210b7b7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:33.774307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d2b64a42-d6fa-4147-ab8c-a3e7f210b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:33.782049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 733/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:05:33.805077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097ddf-80d1-4757-8eaf-2feadfa3bc72 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:33.817479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097ddf-80d1-4757-8eaf-2feadfa3bc72 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:33.822407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:33.823053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:33.823375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:33.823658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:33.824393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:33.826113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:05:33.826113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:05:33.826113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:05:33.827256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1a66-8b31-4286-afa9-ca515f3f60ec admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:33.847645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 745/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 2 09:05:33 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:05:36.102359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6c2b-769d-4487-a452-4a9acdf2da54 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:36.102929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6c2b-769d-4487-a452-4a9acdf2da54 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:36.102929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6c2b-769d-4487-a452-4a9acdf2da54 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:36.104306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 734/1479] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:36.109612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf1ccf-bd1e-4ab2-a4e5-d9fba788759a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:36.110004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf1ccf-bd1e-4ab2-a4e5-d9fba788759a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:36.110175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf1ccf-bd1e-4ab2-a4e5-d9fba788759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:36.128002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e9bf1ccf-bd1e-4ab2-a4e5-d9fba788759a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:36.129199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e9bf1ccf-bd1e-4ab2-a4e5-d9fba788759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:36.137217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 746/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:05:36.180638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6c2b-769d-4487-a452-4a9acdf2da54 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:36.194851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6c2b-769d-4487-a452-4a9acdf2da54 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:36.205847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0c019-2c76-4c95-b38d-5c856541b93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:36.205847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c019-2c76-4c95-b38d-5c856541b93d service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:36.205847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c019-2c76-4c95-b38d-5c856541b93d service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:36.205847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c019-2c76-4c95-b38d-5c856541b93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:36.209720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0c019-2c76-4c95-b38d-5c856541b93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:36.211329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0c019-2c76-4c95-b38d-5c856541b93d service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:36.220788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 735/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:05:38.618343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e2072-0c7f-4ba0-a149-172be13d2619 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:38.618882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e2072-0c7f-4ba0-a149-172be13d2619 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:38.618882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e2072-0c7f-4ba0-a149-172be13d2619 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:38.620382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 747/1482] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:38.625687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46019332-bde8-45f4-9582-3b2aa46e377d None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:38.626088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46019332-bde8-45f4-9582-3b2aa46e377d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:38.626247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46019332-bde8-45f4-9582-3b2aa46e377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:38.644494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-46019332-bde8-45f4-9582-3b2aa46e377d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:38.645686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-46019332-bde8-45f4-9582-3b2aa46e377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:38.653458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 736/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:05:38.688926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e2072-0c7f-4ba0-a149-172be13d2619 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:38.700027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e2072-0c7f-4ba0-a149-172be13d2619 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:38.703463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0c8c8-e5b4-4258-b5b2-001f19e7e9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:38.704094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0c8c8-e5b4-4258-b5b2-001f19e7e9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:38.704375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0c8c8-e5b4-4258-b5b2-001f19e7e9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:38.704654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0c8c8-e5b4-4258-b5b2-001f19e7e9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:38.713300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0c8c8-e5b4-4258-b5b2-001f19e7e9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:38.714718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0c8c8-e5b4-4258-b5b2-001f19e7e9c2 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:38.723832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 748/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:05:41.003451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f22be0-39b2-4a5f-b412-e9810c1b14ec None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:41.004003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f22be0-39b2-4a5f-b412-e9810c1b14ec None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:41.004003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f22be0-39b2-4a5f-b412-e9810c1b14ec None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:41.005363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 737/1485] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:41.010597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa60a68-f4f5-4613-a824-3aafc51ff2ad None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:41.010982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa60a68-f4f5-4613-a824-3aafc51ff2ad None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:41.011156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa60a68-f4f5-4613-a824-3aafc51ff2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:41.029629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1fa60a68-f4f5-4613-a824-3aafc51ff2ad None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:41.030797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1fa60a68-f4f5-4613-a824-3aafc51ff2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:41.039280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 749/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:05:41.076515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f22be0-39b2-4a5f-b412-e9810c1b14ec None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:41.087829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f22be0-39b2-4a5f-b412-e9810c1b14ec None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:41.091333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e46499-8dc9-4787-8357-e282a1c06505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:41.092005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e46499-8dc9-4787-8357-e282a1c06505 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:41.092290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e46499-8dc9-4787-8357-e282a1c06505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:41.092567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e46499-8dc9-4787-8357-e282a1c06505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:41.102225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e46499-8dc9-4787-8357-e282a1c06505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:41.103699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e46499-8dc9-4787-8357-e282a1c06505 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:41.113353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 738/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:05:43.453745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fa6cf-3c33-4f31-bec3-fe71451ea871 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:43.454307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fa6cf-3c33-4f31-bec3-fe71451ea871 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:43.454307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fa6cf-3c33-4f31-bec3-fe71451ea871 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:43.455691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 750/1488] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:43.460915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cd945-0694-44f9-8ff0-876902314875 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:43.461338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cd945-0694-44f9-8ff0-876902314875 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:43.461467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cd945-0694-44f9-8ff0-876902314875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:43.479385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c14cd945-0694-44f9-8ff0-876902314875 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:43.480560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c14cd945-0694-44f9-8ff0-876902314875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:43.488163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 739/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:05:43.527875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fa6cf-3c33-4f31-bec3-fe71451ea871 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:43.539053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fa6cf-3c33-4f31-bec3-fe71451ea871 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:43.542662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4374f1a-05f8-46a8-9e78-02d52970cfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:43.543337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f1a-05f8-46a8-9e78-02d52970cfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:43.543626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f1a-05f8-46a8-9e78-02d52970cfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:43.543902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f1a-05f8-46a8-9e78-02d52970cfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:43.553421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f1a-05f8-46a8-9e78-02d52970cfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:43.554883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f1a-05f8-46a8-9e78-02d52970cfb3 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:43.564324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 751/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:05:46.200505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf170d3-7063-4fa4-a431-444c435b545b None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:46.201065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf170d3-7063-4fa4-a431-444c435b545b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:46.201065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf170d3-7063-4fa4-a431-444c435b545b None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:46.202355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 740/1491] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 2 09:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:05:46.208927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cde89-75e1-461f-8e3b-be8648843926 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:46.209364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cde89-75e1-461f-8e3b-be8648843926 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:46.209467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cde89-75e1-461f-8e3b-be8648843926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:46.226807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-600cde89-75e1-461f-8e3b-be8648843926 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:05:46.228059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-600cde89-75e1-461f-8e3b-be8648843926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:05:46.235801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 752/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 2 09:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:05:46.274329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf170d3-7063-4fa4-a431-444c435b545b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:05:46.284743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf170d3-7063-4fa4-a431-444c435b545b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:05:46.288182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2902f8-849c-4611-bf3d-8ed545e092cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:05:46.288807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2902f8-849c-4611-bf3d-8ed545e092cb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:05:46.289232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2902f8-849c-4611-bf3d-8ed545e092cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:05:46.289518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2902f8-849c-4611-bf3d-8ed545e092cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:05:46.298155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2902f8-849c-4611-bf3d-8ed545e092cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:05:46.299616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2902f8-849c-4611-bf3d-8ed545e092cb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:05:46.309199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 741/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:05:56.221844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=33 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:05:56.305096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=33 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:07:19.679774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:19.680378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:19.680378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:19.697897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:07:19.699090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:19.706914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 753/1494] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:07:19.714666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:19.715121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:19.715258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:19.733401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:07:19.734581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:19.743056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 742/1495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:07:19.747297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:19.756731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189aac1-0286-447d-8d61-d31b51663683 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:19.761159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:19.761809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:19.762353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:19.762633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:19.763395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:07:19.763708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:19.764729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:19.764729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:07:19.764729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:07:19.765611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:19.776954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 754/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:07:19.785224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:19.794382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2afac-cd3c-469d-9f81-4006d529fc23 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:19.798900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:19.800160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:19.800443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:19.800719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:19.801415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:19.803129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:19.803129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:07:19.803129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:07:19.804350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:19.937906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 743/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:07:19 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:07:19.942006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:19.956683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c74c-4859-4fb7-a603-f9a43d21ec93 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:20.009533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:20.010200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.010484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.010760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.011481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:20.012742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:20.012742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:07:20.012742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:07:20.013927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:20.082020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 755/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:07:19 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:07:20.086087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:20.096929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7b94c-d430-41a5-bf4e-44dcc3ee29f6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:20.101424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:20.102352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.105351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.105351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.105351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:20.105351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:20.105351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:07:20.105351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:07:20.105878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:20.118069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 744/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:07:20.121825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:20.131740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40ae7-8467-401c-aefe-cf5b4b4f1198 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:20.136256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:20.136923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.137465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.137746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.138476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:20.139537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:20.139537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:07:20.139537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:07:20.140420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf917564-23d5-4a1f-8e7b-0087fc56bebb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:20.155937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 756/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:07:20.160654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:20.170427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2222aa-1516-4485-971f-6831ace04ee9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:20.174877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:20.175789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.176078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.176358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] PATH_INFO: `/v3/projects/ce16030dbd5c4705b1acf2a4b870e0fe/users/1e4b56ac520341de9a29026c7eee14d4/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.191018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce16030dbd5c4705b1acf2a4b870e0fe, user_id=1e4b56ac520341de9a29026c7eee14d4, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:20.192030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:20.192030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:07:20.192030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:07:20.193961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7958d3f-60e4-42f7-a1a3-3f8510494e41 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:20.256552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 745/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:07:20 2022] PUT /identity/v3/projects/ce16030dbd5c4705b1acf2a4b870e0fe/users/1e4b56ac520341de9a29026c7eee14d4/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:07:20.269513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec1e2-f444-417f-81fd-76012a1be69a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.269803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec1e2-f444-417f-81fd-76012a1be69a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.270081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec1e2-f444-417f-81fd-76012a1be69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.295424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c1aec1e2-f444-417f-81fd-76012a1be69a None None] MFA Rules not processed for user `1e4b56ac520341de9a29026c7eee14d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:07:20.296703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c1aec1e2-f444-417f-81fd-76012a1be69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:20.360749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 757/1502] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:07:20.373867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5407e2-24d7-4f78-8180-29455d30d1ea None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.374160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5407e2-24d7-4f78-8180-29455d30d1ea None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.374437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5407e2-24d7-4f78-8180-29455d30d1ea None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.375849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 746/1503] 10.222.0.18 () {54 vars in 963 bytes} [Thu Jun 2 09:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:07:20.381191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fda73-a282-4ea9-b157-181442d98463 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.381538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fda73-a282-4ea9-b157-181442d98463 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.381756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fda73-a282-4ea9-b157-181442d98463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.400312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3b9fda73-a282-4ea9-b157-181442d98463 None None] MFA Rules not processed for user `3e20e0dbc56e48299b586a3b33c0767d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:07:20.401487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3b9fda73-a282-4ea9-b157-181442d98463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:20.448969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:07:20.450597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 758/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Jun 2 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:07:20.458820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5407e2-24d7-4f78-8180-29455d30d1ea None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:20.469531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5407e2-24d7-4f78-8180-29455d30d1ea None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:20.473072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:20.473709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.473993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.474270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.482382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:20.483850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:20.492546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 747/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:07:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:07:20.535023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879c91a-2d60-4ae1-a46e-e1dbca7a4423 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.535622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879c91a-2d60-4ae1-a46e-e1dbca7a4423 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.536092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879c91a-2d60-4ae1-a46e-e1dbca7a4423 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.537628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 759/1506] 10.222.0.18 () {52 vars in 829 bytes} [Thu Jun 2 09:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:07:20.541364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:20.603210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf17fa-4cf6-4310-bffa-e8e29a6ca829 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:20.607751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:20.608615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.608899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.609179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] PATH_INFO: `/v3/users/1e4b56ac520341de9a29026c7eee14d4` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.610362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4b56ac520341de9a29026c7eee14d4)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:20.611403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:20.611403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:07:20.611403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:07:20.613102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:20.782481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4b56ac520341de9a29026c7eee14d4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:20.794710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4b56ac520341de9a29026c7eee14d4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:20.795425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4b56ac520341de9a29026c7eee14d4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:20.796153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4b56ac520341de9a29026c7eee14d4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:20.814453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4b56ac520341de9a29026c7eee14d4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:20.819186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:07:20.945531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 748/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:07:20 2022] DELETE /identity/v3/users/1e4b56ac520341de9a29026c7eee14d4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:07:20.952699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:20.952699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:20.952699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:20.971705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:07:20.973396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:21.030714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 760/1508] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:07:21.040823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:21.042560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:21.099081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38e66-ff16-4790-bfd2-103a94e15d07 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:21.102764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408eca7-af3d-4a4e-9e1a-79d66ad0bd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:21.103457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408eca7-af3d-4a4e-9e1a-79d66ad0bd24 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:21.103768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408eca7-af3d-4a4e-9e1a-79d66ad0bd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:21.104048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408eca7-af3d-4a4e-9e1a-79d66ad0bd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:21.113519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408eca7-af3d-4a4e-9e1a-79d66ad0bd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:21.114951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408eca7-af3d-4a4e-9e1a-79d66ad0bd24 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:21.124246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 749/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:07:21.841173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:07:21.842682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:07:21.854369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f554b2-0393-4bad-9b1b-3910bfd1230f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:07:21.859043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:07:21.860109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:07:21.860365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:07:21.860639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] PATH_INFO: `/v3/projects/ce16030dbd5c4705b1acf2a4b870e0fe` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:07:21.861842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce16030dbd5c4705b1acf2a4b870e0fe)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:07:21.862877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:07:21.862877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:07:21.862877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:07:21.864145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:07:21.983286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce16030dbd5c4705b1acf2a4b870e0fe', 'request_id': 'req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:21.996264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce16030dbd5c4705b1acf2a4b870e0fe', 'request_id': 'req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:22.076225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce16030dbd5c4705b1acf2a4b870e0fe', 'request_id': 'req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:22.097620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] The token cache is being invalidate because project ce16030dbd5c4705b1acf2a4b870e0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:07:22.097620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:22.097620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-99bdddd1-eb08-48a1-a6c5-1ae5f041d0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:07:22.097620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 761/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:07:21 2022] DELETE /identity/v3/projects/ce16030dbd5c4705b1acf2a4b870e0fe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:07:31.120187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:07:32.084426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:08:57.138573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef6c2-3719-4af7-8f40-9429a185eea5 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:57.139146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef6c2-3719-4af7-8f40-9429a185eea5 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:57.139281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef6c2-3719-4af7-8f40-9429a185eea5 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:57.140675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:08:57.146084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e83bd-15ea-4c15-bc2d-5e27fbf63873 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:57.146515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e83bd-15ea-4c15-bc2d-5e27fbf63873 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:57.146619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e83bd-15ea-4c15-bc2d-5e27fbf63873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:57.164141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-230e83bd-15ea-4c15-bc2d-5e27fbf63873 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:08:57.165318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-230e83bd-15ea-4c15-bc2d-5e27fbf63873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:08:57.222852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:08:57.390587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef6c2-3719-4af7-8f40-9429a185eea5 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:08:57.392352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-bdfef6c2-3719-4af7-8f40-9429a185eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:08:57.467357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef6c2-3719-4af7-8f40-9429a185eea5 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:08:57.472767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea257d-67f4-47a6-99a4-d1e4614e79d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:08:57.473470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea257d-67f4-47a6-99a4-d1e4614e79d5 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:57.473706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea257d-67f4-47a6-99a4-d1e4614e79d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:57.474124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea257d-67f4-47a6-99a4-d1e4614e79d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:57.486187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea257d-67f4-47a6-99a4-d1e4614e79d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:08:57.487844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea257d-67f4-47a6-99a4-d1e4614e79d5 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:08:57.498098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 751/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:08:58.368194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89951223-9058-431b-9468-0e86ab6579a1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:58.368719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89951223-9058-431b-9468-0e86ab6579a1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:58.368719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89951223-9058-431b-9468-0e86ab6579a1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:58.370072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:08:58.374726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb46a2d-07aa-44d7-b0b4-e9c87879a1ef None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:58.375515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb46a2d-07aa-44d7-b0b4-e9c87879a1ef None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:58.375794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb46a2d-07aa-44d7-b0b4-e9c87879a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:58.394201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9eb46a2d-07aa-44d7-b0b4-e9c87879a1ef None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:08:58.396143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9eb46a2d-07aa-44d7-b0b4-e9c87879a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:08:58.404127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:08:58.553893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89951223-9058-431b-9468-0e86ab6579a1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:08:58.568397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89951223-9058-431b-9468-0e86ab6579a1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:08:58.573628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c56739-ee8d-40ad-9ec1-ab8023708c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:08:58.574254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56739-ee8d-40ad-9ec1-ab8023708c0d service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:58.574537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56739-ee8d-40ad-9ec1-ab8023708c0d service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:58.574814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56739-ee8d-40ad-9ec1-ab8023708c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:58.583394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c56739-ee8d-40ad-9ec1-ab8023708c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:08:58.584959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c56739-ee8d-40ad-9ec1-ab8023708c0d service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:08:58.594120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 764/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:08:58.678456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca733-66d1-4a20-9d8e-04b4a3ff7a22 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:58.678773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca733-66d1-4a20-9d8e-04b4a3ff7a22 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:58.679050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca733-66d1-4a20-9d8e-04b4a3ff7a22 None None] PATH_INFO: `/v3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:58.680420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 753/1517] 10.222.0.45 () {54 vars in 925 bytes} [Thu Jun 2 09:08:58 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:08:58.687203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c896-d663-40c0-a241-42d0db369ef7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:08:58.687539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c896-d663-40c0-a241-42d0db369ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:08:58.687820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c896-d663-40c0-a241-42d0db369ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:08:58.706649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e302c896-d663-40c0-a241-42d0db369ef7 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:08:58.708635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e302c896-d663-40c0-a241-42d0db369ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:08:58.772297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 765/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jun 2 09:08:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:07.994023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f2da-172d-4c06-91e3-094f5e49cb67 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:07.994538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f2da-172d-4c06-91e3-094f5e49cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:07.994538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f2da-172d-4c06-91e3-094f5e49cb67 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:07.995956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 754/1519] 10.222.0.18 () {54 vars in 960 bytes} [Thu Jun 2 09:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:08.000826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef867-ac17-4b6f-84a5-ce83ec5179d8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:08.001274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef867-ac17-4b6f-84a5-ce83ec5179d8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:08.001384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef867-ac17-4b6f-84a5-ce83ec5179d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:08.020200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d5fef867-ac17-4b6f-84a5-ce83ec5179d8 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:08.021392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d5fef867-ac17-4b6f-84a5-ce83ec5179d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:08.029783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 766/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Thu Jun 2 09:09:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:08.037846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3f2da-172d-4c06-91e3-094f5e49cb67 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:08.050646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3f2da-172d-4c06-91e3-094f5e49cb67 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:08.055466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68306c64-8bf8-4faa-bb07-49a9f9e59191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:08.056090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68306c64-8bf8-4faa-bb07-49a9f9e59191 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:08.056371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68306c64-8bf8-4faa-bb07-49a9f9e59191 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:08.056643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68306c64-8bf8-4faa-bb07-49a9f9e59191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:08.064772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68306c64-8bf8-4faa-bb07-49a9f9e59191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:08.066339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68306c64-8bf8-4faa-bb07-49a9f9e59191 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:08.075792 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 755/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:09.867423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91451b-0001-4455-837c-c49c7a6938cb None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:09.867975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91451b-0001-4455-837c-c49c7a6938cb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:09.867975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91451b-0001-4455-837c-c49c7a6938cb None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:09.869376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:09.874045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed329-4104-480b-848e-627f73fb95a9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:09.874467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed329-4104-480b-848e-627f73fb95a9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:09.874604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed329-4104-480b-848e-627f73fb95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:09.893361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f4eed329-4104-480b-848e-627f73fb95a9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:09.895193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f4eed329-4104-480b-848e-627f73fb95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:09.903107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:10.053575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91451b-0001-4455-837c-c49c7a6938cb None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:10.068403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91451b-0001-4455-837c-c49c7a6938cb None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:10.073785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bc42-097e-4d3e-ba0d-5ddd1468c379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:10.074421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bc42-097e-4d3e-ba0d-5ddd1468c379 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:10.074706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bc42-097e-4d3e-ba0d-5ddd1468c379 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:10.074987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bc42-097e-4d3e-ba0d-5ddd1468c379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:10.083148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899bc42-097e-4d3e-ba0d-5ddd1468c379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:10.084759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899bc42-097e-4d3e-ba0d-5ddd1468c379 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:10.094051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 768/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:10.952922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1270-0788-4629-a41b-24aefc311c31 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:10.953356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1270-0788-4629-a41b-24aefc311c31 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:10.953471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1270-0788-4629-a41b-24aefc311c31 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:10.954830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 09:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:10.959741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549829-4000-4248-8262-2897fe784ba8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:10.960165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549829-4000-4248-8262-2897fe784ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:10.960308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549829-4000-4248-8262-2897fe784ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:10.978148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-94549829-4000-4248-8262-2897fe784ba8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:10.979387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-94549829-4000-4248-8262-2897fe784ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:10.987172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 09:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:11.139252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1270-0788-4629-a41b-24aefc311c31 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:11.153142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1270-0788-4629-a41b-24aefc311c31 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:11.158385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bbbf-19f5-41ae-96d5-e48a78c76680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:11.159010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bbbf-19f5-41ae-96d5-e48a78c76680 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:11.159324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bbbf-19f5-41ae-96d5-e48a78c76680 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:11.159601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bbbf-19f5-41ae-96d5-e48a78c76680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:11.168001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bbbf-19f5-41ae-96d5-e48a78c76680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:11.169559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bbbf-19f5-41ae-96d5-e48a78c76680 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:11.179320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 758/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:15.097906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3063-2d80-46a9-85ca-9dbdd73b3fd4 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:15.098492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3063-2d80-46a9-85ca-9dbdd73b3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:15.098492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3063-2d80-46a9-85ca-9dbdd73b3fd4 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:15.099877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:15.105216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f9f20-ac3f-4916-9e49-ff40797dad07 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:15.105650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f9f20-ac3f-4916-9e49-ff40797dad07 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:15.105815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f9f20-ac3f-4916-9e49-ff40797dad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:15.123482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-118f9f20-ac3f-4916-9e49-ff40797dad07 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:15.124680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-118f9f20-ac3f-4916-9e49-ff40797dad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:15.133156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:15.169497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3063-2d80-46a9-85ca-9dbdd73b3fd4 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:15.171158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a2aa3063-2d80-46a9-85ca-9dbdd73b3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:15.227170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa3063-2d80-46a9-85ca-9dbdd73b3fd4 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:15.230684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5bb84-700d-461e-9e85-9ce5037e5a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:15.231357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5bb84-700d-461e-9e85-9ce5037e5a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:15.231645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5bb84-700d-461e-9e85-9ce5037e5a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:15.231924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5bb84-700d-461e-9e85-9ce5037e5a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:15.241211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5bb84-700d-461e-9e85-9ce5037e5a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:15.242637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5bb84-700d-461e-9e85-9ce5037e5a6b service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:15.247479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:09:15.252128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 771/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:17.478195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7528-d7e6-44b4-8259-3c4db2115163 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:17.478779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7528-d7e6-44b4-8259-3c4db2115163 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:17.478779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7528-d7e6-44b4-8259-3c4db2115163 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:17.480156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:17.485289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6fe7d-4c62-4e4a-922e-5e3dd69cc1de None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:17.485726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6fe7d-4c62-4e4a-922e-5e3dd69cc1de None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:17.485834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6fe7d-4c62-4e4a-922e-5e3dd69cc1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:17.504364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e6c6fe7d-4c62-4e4a-922e-5e3dd69cc1de None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:17.505543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e6c6fe7d-4c62-4e4a-922e-5e3dd69cc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:17.513500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:17.549010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7528-d7e6-44b4-8259-3c4db2115163 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:17.559730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7528-d7e6-44b4-8259-3c4db2115163 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:17.563222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c764349-4825-49d3-a532-27aaac754677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:17.563933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c764349-4825-49d3-a532-27aaac754677 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:17.564214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c764349-4825-49d3-a532-27aaac754677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:17.564487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c764349-4825-49d3-a532-27aaac754677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:17.573080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c764349-4825-49d3-a532-27aaac754677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:17.574493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c764349-4825-49d3-a532-27aaac754677 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:17.584214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 761/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:21.390731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ce98-d5e9-4fa4-978c-2fbbdf6c4db3 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:21.391334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ce98-d5e9-4fa4-978c-2fbbdf6c4db3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:21.391334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ce98-d5e9-4fa4-978c-2fbbdf6c4db3 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:21.392720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:21.398648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72dfe7-9c8c-4e03-9a28-f6566399681c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:21.399067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72dfe7-9c8c-4e03-9a28-f6566399681c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:21.399180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72dfe7-9c8c-4e03-9a28-f6566399681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:21.405459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=62 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:09:21.417799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7e72dfe7-9c8c-4e03-9a28-f6566399681c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:21.425278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7e72dfe7-9c8c-4e03-9a28-f6566399681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:21.426982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:21.693764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ce98-d5e9-4fa4-978c-2fbbdf6c4db3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:21.695504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9538ce98-d5e9-4fa4-978c-2fbbdf6c4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:21.752613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ce98-d5e9-4fa4-978c-2fbbdf6c4db3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:21.756674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decaf7a8-c0a3-4580-8e3f-0be517d495f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:21.757316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaf7a8-c0a3-4580-8e3f-0be517d495f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:21.757602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaf7a8-c0a3-4580-8e3f-0be517d495f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:21.757882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decaf7a8-c0a3-4580-8e3f-0be517d495f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:21.766930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaf7a8-c0a3-4580-8e3f-0be517d495f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:21.768380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decaf7a8-c0a3-4580-8e3f-0be517d495f8 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:21.778136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 774/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:24.041083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee716e-e5c3-4a89-8e18-369a6cd641a6 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:24.043000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee716e-e5c3-4a89-8e18-369a6cd641a6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:24.043000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee716e-e5c3-4a89-8e18-369a6cd641a6 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:24.043186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 09:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:09:24.048309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b5bd-e5b1-4070-9087-01661f84f30b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:24.048717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b5bd-e5b1-4070-9087-01661f84f30b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:24.048859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b5bd-e5b1-4070-9087-01661f84f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:24.066744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-25b7b5bd-e5b1-4070-9087-01661f84f30b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:09:24.068020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-25b7b5bd-e5b1-4070-9087-01661f84f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:24.075700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 09:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:09:24.341190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee716e-e5c3-4a89-8e18-369a6cd641a6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:09:24.342904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-66ee716e-e5c3-4a89-8e18-369a6cd641a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:09:24.357016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee716e-e5c3-4a89-8e18-369a6cd641a6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:09:24.360675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bdc19-0a6e-430b-9d1f-4e05ac1894cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:09:24.361320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bdc19-0a6e-430b-9d1f-4e05ac1894cf service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:09:24.361727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bdc19-0a6e-430b-9d1f-4e05ac1894cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:09:24.362010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bdc19-0a6e-430b-9d1f-4e05ac1894cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:09:24.371739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bdc19-0a6e-430b-9d1f-4e05ac1894cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:09:24.373168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bdc19-0a6e-430b-9d1f-4e05ac1894cf service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:09:24.382503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 764/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:09:34.061996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=32 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:09:34.378852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=8 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:54.888630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95984f6-8055-462b-9cab-385b070f0b51 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:54.897329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95984f6-8055-462b-9cab-385b070f0b51 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:54.897329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95984f6-8055-462b-9cab-385b070f0b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:54.913865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967ee5f-9dbc-44ad-988d-3e0b2dda7063 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:54.914515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967ee5f-9dbc-44ad-988d-3e0b2dda7063 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:54.915055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967ee5f-9dbc-44ad-988d-3e0b2dda7063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:54.923965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b95984f6-8055-462b-9cab-385b070f0b51 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:54.925691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b95984f6-8055-462b-9cab-385b070f0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:54.942688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 776/1540] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:54.952825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:54.953517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:54.953899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:54.968298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5967ee5f-9dbc-44ad-988d-3e0b2dda7063 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:54.969671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5967ee5f-9dbc-44ad-988d-3e0b2dda7063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:54.986503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 765/1541] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:10:54.988472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:54.989813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:54.997023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:54.997994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:54.997994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.004421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 777/1542] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.009769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.024956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa601-8836-4264-b6dd-e331b3c22d2a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.027409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.028709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.035292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.036021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.036316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.036594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.037323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.037682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.039574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aae15-152c-4da8-a35e-d2a0d23becef admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.045304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 766/1543] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.050092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.059299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 778/1544] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:10:55.064589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9335ef-0ecb-4caf-aa93-83e3c591e55f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.064589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9335ef-0ecb-4caf-aa93-83e3c591e55f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.064589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9335ef-0ecb-4caf-aa93-83e3c591e55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.069674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267aac9-a6c3-494d-a568-40d341adc826 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.080821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.081520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.081812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.082197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.082927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.083271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.084315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:10:55.084315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:10:55.084315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:10:55.085477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.096357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8c9335ef-0ecb-4caf-aa93-83e3c591e55f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.097634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8c9335ef-0ecb-4caf-aa93-83e3c591e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.106282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 767/1545] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:55.107431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.113468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 779/1546] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.114588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870e693-8cfe-436a-bca1-51efd3340b04 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.114877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870e693-8cfe-436a-bca1-51efd3340b04 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.115153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870e693-8cfe-436a-bca1-51efd3340b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.128089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe31f1-c3ff-4ece-ab99-758bae2469ef admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.138247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ffece-3737-406a-8b02-ce15dd4f8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.139328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ffece-3737-406a-8b02-ce15dd4f8536 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.139834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ffece-3737-406a-8b02-ce15dd4f8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.140329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ffece-3737-406a-8b02-ce15dd4f8536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.141239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ffece-3737-406a-8b02-ce15dd4f8536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.143720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ffece-3737-406a-8b02-ce15dd4f8536 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.144419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d870e693-8cfe-436a-bca1-51efd3340b04 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.149298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d870e693-8cfe-436a-bca1-51efd3340b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.162613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 780/1547] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.164061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.164356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.164634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.191568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.192768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.202472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 781/1548] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.203267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.213915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99affd-37bb-49ce-9008-fa9e74d9c03e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.219257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.220566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.220904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.221189 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.221891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.222914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:10:55.222914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:10:55.222914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:10:55.224134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfeefe-47dc-45fd-81e6-1836a3cd515a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.239987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 768/1549] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.241757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130c70-bccb-40ff-9050-5338a073c8bc None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.242255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130c70-bccb-40ff-9050-5338a073c8bc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.244769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130c70-bccb-40ff-9050-5338a073c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.266482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-80130c70-bccb-40ff-9050-5338a073c8bc None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.267822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-80130c70-bccb-40ff-9050-5338a073c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.330677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 782/1550] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.331101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 769/1551] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.332155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.332279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f513c-6e61-4c7c-954a-56d6bb7ef7f0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.332475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.332593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f513c-6e61-4c7c-954a-56d6bb7ef7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.332865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.332991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f513c-6e61-4c7c-954a-56d6bb7ef7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.350922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.352210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.353357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a16f513c-6e61-4c7c-954a-56d6bb7ef7f0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.354530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a16f513c-6e61-4c7c-954a-56d6bb7ef7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.413587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 770/1552] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.414394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.423620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f73f4-c566-4ae0-ab16-f4ebaf9ddb4a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.424748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 783/1553] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.425866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd7bd-66e6-4e54-8b4d-bae2c6fc7a8b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.426157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd7bd-66e6-4e54-8b4d-bae2c6fc7a8b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.426435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd7bd-66e6-4e54-8b4d-bae2c6fc7a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.434940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.435686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.435973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.436251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.436948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.438029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:10:55.438029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:10:55.438029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:10:55.439707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.444813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-844cd7bd-66e6-4e54-8b4d-bae2c6fc7a8b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.445996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-844cd7bd-66e6-4e54-8b4d-bae2c6fc7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.454523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 784/1554] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.455895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e53ab-e50d-4276-99c9-01e48daf93bf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.460811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e53ab-e50d-4276-99c9-01e48daf93bf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.460811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e53ab-e50d-4276-99c9-01e48daf93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.473688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cf1e53ab-e50d-4276-99c9-01e48daf93bf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.474855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cf1e53ab-e50d-4276-99c9-01e48daf93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.483043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 785/1555] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.484296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.484561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.484836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.502528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.503717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.511850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 771/1556] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.519621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 786/1557] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.519621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.519810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.522351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff604e37-9a55-40d7-9b7e-7d31f17d9922 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.525089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc58322-2833-456f-ac9c-1e53640dcb0b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.526951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4338b2-9666-4216-bb4e-8ff3c428d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.527780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4338b2-9666-4216-bb4e-8ff3c428d856 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.528056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4338b2-9666-4216-bb4e-8ff3c428d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.528336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4338b2-9666-4216-bb4e-8ff3c428d856 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.529055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4338b2-9666-4216-bb4e-8ff3c428d856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.529657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.530312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.530600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.530876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.530984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4338b2-9666-4216-bb4e-8ff3c428d856 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.531628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.531966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.533657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.546514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 772/1558] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:55.547348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.557192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf16b2e-a04b-4bba-8f76-dbc90ab113fc admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.561705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.562325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.562612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.562889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.563636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.563942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.565520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.576745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 773/1559] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:55.577498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.587391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613222d-65bd-4f23-86ac-d0a535e2c55d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.592113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.595122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.595122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.595122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.595122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.595122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.595921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196676d7-2313-4612-bb66-8c263c25dbf0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.598267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:55.609743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 774/1560] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:55.611060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.611387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.611669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.620503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 787/1561] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.622173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f5ae-33d0-4675-8eb9-6008f3e71498 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.625787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f5ae-33d0-4675-8eb9-6008f3e71498 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.625787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f5ae-33d0-4675-8eb9-6008f3e71498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.632723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.633933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.642428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c4f0f5ae-33d0-4675-8eb9-6008f3e71498 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.642562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 775/1562] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.643425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.643718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c4f0f5ae-33d0-4675-8eb9-6008f3e71498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.652687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 788/1563] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.659276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.659276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.659276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.659597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1c17d-f512-4619-b4a9-b8e7bf805fbb None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.660536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.661032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.661315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.661589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.662313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.664689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.673481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:55.677396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:55.677550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 776/1564] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:55.677550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.683962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 789/1565] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:55.683962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.688517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d04fb-3152-4ca5-a45f-bd376334d07c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.693208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.693864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.694182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.694284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3ad0f-7c46-4f91-9945-7586916e87d1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.694463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.695187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.697164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.698823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.699490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.699774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.700047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.700757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.702657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.796794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 777/1566] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.796794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.801992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 790/1567] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.801992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.823322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:55.857421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f9261-8af7-4d1d-b1ba-527d89300a4a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.862386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.863060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.863378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.863657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.864349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.865560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2b27-a2b6-45fe-8edb-cadc06b7df51 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.866843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.870807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.871498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.871781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.872057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.872794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.874416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.884916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 791/1568] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:55.885934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.896249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffebe0-9d13-4ec8-91dc-591355e7f042 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.900848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.901504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.901785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.902061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.902773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.903073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.904678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.915947 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 792/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:55.916610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.927808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268302d6-a3f9-4b6f-a99c-65d24fd52771 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.932839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.933485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.933766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.934042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.934756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:55.935061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.936667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.949118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 793/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:55.950098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.959148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36eb73-9bc2-4601-a29e-44266fbfe14a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:55.963770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:55.964408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:55.967646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:55.967754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 778/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:55.968213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:55.968321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.968423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:55.968423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:55.979122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 794/1572] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:55.979937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:55.991648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c2d4-59f6-40a2-a638-606d7d7bb243 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.028490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b3d13-f5fc-4303-98f6-0bf26de9b9e8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.033064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.033723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.034008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.034284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.034998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:10:56.035326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.036927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.048949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 779/1573] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:10:56.049758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.054348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.055066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.055389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.055671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.056401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.058375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.065502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21ed8f-3806-4438-ae93-88c5524b454d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.070776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.071356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.071641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.071915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.072599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.074521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.181451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 795/1574] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:55 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.182307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.191631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d58f3-b928-4a50-ad72-1e8e52e0be07 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.196269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.196962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.197249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.197528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.198244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.199886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.209772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 796/1575] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:56.210619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.214210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 780/1576] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.214210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.220155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b4bd-8392-44f0-8c37-6f1eaeca2879 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.224201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0757-dc5d-4466-81c3-5d63572ede13 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.224678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.225893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.226179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.226459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.227147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.229074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.229807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.230518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.230807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.231089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.231832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.233921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.248638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:56.307857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 797/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.308686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.341169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 781/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.341991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.350094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:56.372453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84d7c-12f4-49b0-95eb-46dbf0040da7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.402512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152dd7-9de8-4093-8a07-dd29c1fbc0a5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.407161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.408089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.408375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.408655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] PATH_INFO: `/v3/projects/597dc461d8a042e19ad99324a626aac1/users/0d89a238fc8047cdaaac1047a675cfbb/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.424232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=597dc461d8a042e19ad99324a626aac1, user_id=0d89a238fc8047cdaaac1047a675cfbb, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.426915 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.427501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.428175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.428483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.428762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.429448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.431430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.512094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 782/1579] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:56 2022] PUT /identity/v3/projects/597dc461d8a042e19ad99324a626aac1/users/0d89a238fc8047cdaaac1047a675cfbb/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:56.513075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.537468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 798/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.537468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.547483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7dd58-e47c-425f-89b2-37a5f992aa0d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.576303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928d325-f554-4400-82e0-9895533dc52b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.580896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.581549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.581830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.582105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.582789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.585209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.603124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.603872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.604160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.604444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.605166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.606767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.616600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 799/1581] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:56.617382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.626573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17717fc-f06e-421d-877d-ff4a0ca8717e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.631117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.631844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.634829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.634829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.634829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.634829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.645224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 800/1582] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:56.647656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.655585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d361671-79e9-46c0-af5f-c27ebb67dc32 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.660058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.660882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.661171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.661453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] PATH_INFO: `/v3/projects/24a81b035f834106b49c35c847f246d6/users/58b706e007fa46c7b8a69508455fcdba/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.676441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a81b035f834106b49c35c847f246d6, user_id=58b706e007fa46c7b8a69508455fcdba, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.680315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 783/1583] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/projects => generated 357 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.680315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.680555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:10:56.680555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:10:56.680555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:10:56.680555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.738652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279139-f21d-439c-8525-2bbc02091320 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.743839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde00d8-b25b-4b87-862b-3556a2880a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.744508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde00d8-b25b-4b87-862b-3556a2880a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.744791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde00d8-b25b-4b87-862b-3556a2880a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.745067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde00d8-b25b-4b87-862b-3556a2880a0d admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.745756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde00d8-b25b-4b87-862b-3556a2880a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.747745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde00d8-b25b-4b87-862b-3556a2880a0d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.756378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:56.761322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 801/1584] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:56 2022] PUT /identity/v3/projects/24a81b035f834106b49c35c847f246d6/users/58b706e007fa46c7b8a69508455fcdba/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:56.762211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.795717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:56.822197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49645-4898-4ed2-8aba-f8bfb829ed90 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.826780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.827474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.827764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.828045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.828776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.830689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.875193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 784/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.876683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.876969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.877247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.894113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:56.906591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:56.906747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 802/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:56.906747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.907358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 785/1587] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:56.907358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.909687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e557f0-cac0-4ab8-82eb-e799a1b7717e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.914174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f6a5a-e5e4-499e-ba08-4d597ba99460 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.915325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.915993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.916367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.916612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.917358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.918978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.919084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.919728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.920010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.920381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.921014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.922726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.931284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 803/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:56.933488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.937204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 786/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:56.937204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:56.942077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a6c0-ec74-4668-89e5-e61a30eaabdf admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.946722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2c16-6678-4c57-846e-38eb78a25054 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:56.946865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f471e-5114-4945-9546-6e75181ac80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.947549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f471e-5114-4945-9546-6e75181ac80b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.947838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f471e-5114-4945-9546-6e75181ac80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.948119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f471e-5114-4945-9546-6e75181ac80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.948849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f471e-5114-4945-9546-6e75181ac80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.950455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f471e-5114-4945-9546-6e75181ac80b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.951392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:56.952184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.952745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.952745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.953427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:56.955396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:56.962384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 804/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:56.963637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:56.967900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:56.967900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:56.980583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:56.981771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:56.989286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 805/1591] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:56.990034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.000255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dbcf9-e8ce-4438-becc-ab5328c014cf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.005390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.006061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.006346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.006677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.007434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.009928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.021888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 806/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.022712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.032361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0bd26-f351-44e4-9f1a-94a618913b61 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.037294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.038465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.038749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.039029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.039787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.041394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.043930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 787/1593] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:56 2022] POST /identity/v3/users => generated 279 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:57.048524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.055344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 807/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.055344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.063085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf7f8f-3837-4b2e-b128-1263451c5d17 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.069145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.069792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.070073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.070344 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.071063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.072699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.082669 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 808/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.083483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.093197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c82a-66c1-4850-9e0a-7da1864e9ae4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.097752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.098619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.098903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.099178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] PATH_INFO: `/v3/projects/783b51e86d404ac5af434056d55e797f/users/aac67129a0da48658220b42f27a33f45/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.106804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aed80-6fc9-4f94-b879-4089d6085cdd admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.110518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.111170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.111489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.111765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.115172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783b51e86d404ac5af434056d55e797f, user_id=aac67129a0da48658220b42f27a33f45, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.117919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.122188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.123734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.133400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 788/1596] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:10:57.134174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.144562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2524d-5816-400b-a9f9-f0c605712279 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.149731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.150629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.150913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.151189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] PATH_INFO: `/v3/projects/e9f83fda27fa48c287ef116fe0d32bb7/users/3fa6ac6f8de54472b4608708ceed2269/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.167474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f83fda27fa48c287ef116fe0d32bb7, user_id=3fa6ac6f8de54472b4608708ceed2269, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.170158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.214727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 809/1597] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:57 2022] PUT /identity/v3/projects/783b51e86d404ac5af434056d55e797f/users/aac67129a0da48658220b42f27a33f45/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:57.215627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.237532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 789/1598] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:57 2022] PUT /identity/v3/projects/e9f83fda27fa48c287ef116fe0d32bb7/users/3fa6ac6f8de54472b4608708ceed2269/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:57.239422 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.295924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee631ca-838b-4454-8d88-fa098e211250 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.314153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e743a-7c1a-40f1-9b1c-da3e6f237eb5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.321764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.322445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.322726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.322997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.324708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.328456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.337594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 790/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.339561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.351355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eebcbb-33bd-40a9-9305-b97c6f6271f5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.356131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.356596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.356785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.357066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.357254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.357360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.357541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.357822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.358042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.359683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.365220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.368278 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.371456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.372501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 791/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.373287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.380244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 810/1601] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:10:57.381147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.384298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167daff9-aca7-4ebf-8262-73f83a3fe895 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.390847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6c6aa-34b1-4064-9c5b-a5d897f747eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.391551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c6aa-34b1-4064-9c5b-a5d897f747eb admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.391837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c6aa-34b1-4064-9c5b-a5d897f747eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.391961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238122-a6dd-4a7f-a73f-b82f4f904150 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.392109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c6aa-34b1-4064-9c5b-a5d897f747eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.393146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6c6aa-34b1-4064-9c5b-a5d897f747eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.394433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6c6aa-34b1-4064-9c5b-a5d897f747eb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.398347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.399478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.399932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.400376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] PATH_INFO: `/v3/projects/088ecec3bdbf404fa8474235018235ca/users/c99330cccfea41abbb7bc5b34956c612/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.409241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 792/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.410844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d9e5-d2d4-405a-a348-8d0c5f4d0a97 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.414694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d9e5-d2d4-405a-a348-8d0c5f4d0a97 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.414694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d9e5-d2d4-405a-a348-8d0c5f4d0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.421608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088ecec3bdbf404fa8474235018235ca, user_id=c99330cccfea41abbb7bc5b34956c612, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.424863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.434942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.443192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9776d9e5-d2d4-405a-a348-8d0c5f4d0a97 None None] MFA Rules not processed for user `aac67129a0da48658220b42f27a33f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:57.444976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9776d9e5-d2d4-405a-a348-8d0c5f4d0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:57.527600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 793/1603] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:57.528911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.529205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.529490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.564395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] MFA Rules not processed for user `3fa6ac6f8de54472b4608708ceed2269`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:57.566414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:57.572740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 811/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:57 2022] PUT /identity/v3/projects/088ecec3bdbf404fa8474235018235ca/users/c99330cccfea41abbb7bc5b34956c612/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:57.576295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.646837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88790-dd01-4876-8a8b-bbada91e9f20 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.652757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa39a3-c0bc-404f-842a-e8043b29840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.653473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 794/1605] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:57.653734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa39a3-c0bc-404f-842a-e8043b29840d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.654031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa39a3-c0bc-404f-842a-e8043b29840d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.654305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa39a3-c0bc-404f-842a-e8043b29840d admin admin] PATH_INFO: `/v3/projects/1869e20213214111a0dfcda8b7abeecc/users/bc0272ac06464fb7b430bc8c664208dd/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.655122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.668849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320057d0-f6bf-4534-b34b-4989ada9f103 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.671088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa39a3-c0bc-404f-842a-e8043b29840d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1869e20213214111a0dfcda8b7abeecc, user_id=bc0272ac06464fb7b430bc8c664208dd, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.673897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa39a3-c0bc-404f-842a-e8043b29840d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.675378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.676367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.677087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.677378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.678110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.679780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.693507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 795/1606] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:57.696700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.706539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d9a71-7398-473c-8c4c-d92472af159e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.717284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.718281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.718568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.718847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] PATH_INFO: `/v3/projects/29cdecaa188244d4ad97aa428f505a4d/users/ba3314db45984ace815bb76e89224506/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.736355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cdecaa188244d4ad97aa428f505a4d, user_id=ba3314db45984ace815bb76e89224506, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.738384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.776451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 812/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:57 2022] PUT /identity/v3/projects/1869e20213214111a0dfcda8b7abeecc/users/bc0272ac06464fb7b430bc8c664208dd/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:57.777949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a10cb-4d7d-4263-81e1-8343f2b839e2 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.778304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a10cb-4d7d-4263-81e1-8343f2b839e2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.778652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a10cb-4d7d-4263-81e1-8343f2b839e2 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.780165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 813/1608] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 09:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:10:57.781312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.781688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.782034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.803571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:57.804763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:57.828559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 796/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:57 2022] PUT /identity/v3/projects/29cdecaa188244d4ad97aa428f505a4d/users/ba3314db45984ace815bb76e89224506/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:57.829664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.892739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 814/1610] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:57.894468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:57.906852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7f61-7057-4e10-85a9-77049e74cd68 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.939874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.948752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2037c7-795d-4a66-8535-5170f3f6dca6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:57.954086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67487cd3-3c5c-4f47-bd8b-501a08538c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.954778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67487cd3-3c5c-4f47-bd8b-501a08538c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.955067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67487cd3-3c5c-4f47-bd8b-501a08538c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.955421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67487cd3-3c5c-4f47-bd8b-501a08538c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.956381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67487cd3-3c5c-4f47-bd8b-501a08538c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.958329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67487cd3-3c5c-4f47-bd8b-501a08538c38 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:57.967451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.976254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3b1ec-5cb2-4d32-80ac-dd5445c209a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:57.977167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3b1ec-5cb2-4d32-80ac-dd5445c209a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:57.977458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3b1ec-5cb2-4d32-80ac-dd5445c209a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:57.977741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3b1ec-5cb2-4d32-80ac-dd5445c209a4 admin admin] PATH_INFO: `/v3/projects/b7cf053fd53e4e3489101424ebd4390d/users/b899938479044bdc9be764dddf2029f1/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:57.993557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3b1ec-5cb2-4d32-80ac-dd5445c209a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cf053fd53e4e3489101424ebd4390d, user_id=b899938479044bdc9be764dddf2029f1, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:57.996255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3b1ec-5cb2-4d32-80ac-dd5445c209a4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.079501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 815/1611] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:57 2022] PUT /identity/v3/projects/b7cf053fd53e4e3489101424ebd4390d/users/b899938479044bdc9be764dddf2029f1/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:58.080800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 797/1612] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:57 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:58.081566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.082015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.082584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.085287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28030c8-b424-4a4e-9699-29986a89ae47 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.085697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28030c8-b424-4a4e-9699-29986a89ae47 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.086051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28030c8-b424-4a4e-9699-29986a89ae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.105304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e28030c8-b424-4a4e-9699-29986a89ae47 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:58.106515 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e28030c8-b424-4a4e-9699-29986a89ae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:58.113069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:58.113069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:58.182613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 798/1613] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:58.184249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69c11-0afb-471d-a771-df64efa5d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.184550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69c11-0afb-471d-a771-df64efa5d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.184817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69c11-0afb-471d-a771-df64efa5d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.188176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 816/1614] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:58.188176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.246206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-40c69c11-0afb-471d-a771-df64efa5d7c7 None None] MFA Rules not processed for user `ba3314db45984ace815bb76e89224506`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:58.246206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-40c69c11-0afb-471d-a771-df64efa5d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:58.261058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3e564-78ec-494d-9baf-b8516cf020e1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.265900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.266588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.266878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.267162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.276812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.278269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.288668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 817/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:10:58.289462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.298455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae97b11-b8f7-452f-8162-afed5bac84f8 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.304859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.305542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.305827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.306106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.306941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.308921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.322701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 799/1616] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:58.323979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.324275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.324556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.352583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] MFA Rules not processed for user `b899938479044bdc9be764dddf2029f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:58.353807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:58.399272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 818/1617] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:58.400495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.408289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:58.411190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d5d1d-0906-4971-ad8e-69ec3c85dd94 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.415626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.416279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.416567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.416847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.436364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.438228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.445763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 800/1618] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:58.445763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.458754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 819/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:10:58.459674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.465996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094c0d-57bb-4122-94b2-9d1838f38af9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.469351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17a624-fd76-4d6d-9467-343fcaa75ec2 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.474257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.474757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.475028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.475907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.476280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.477003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.477275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.477698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.478140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.479098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.572253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.579409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.584305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 801/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:10:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:10:58.585613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.597294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c7b63-7ed1-4818-b7ed-ee0de4d7f898 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.603365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.610709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.610709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.610709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.610709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.610709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.611537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 820/1621] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:58.613317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.622329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 802/1622] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:58.623503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.652838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:58.653916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cf769-b107-4612-9469-015eadcfc672 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.727508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf7e0-f919-473f-9807-4d0770a57f81 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.733280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.734291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.734791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.735522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.736809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.739758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.753127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34db01-8367-40ef-9949-a0ebc89b6610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.753893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34db01-8367-40ef-9949-a0ebc89b6610 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.754204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34db01-8367-40ef-9949-a0ebc89b6610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.754477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34db01-8367-40ef-9949-a0ebc89b6610 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.755178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34db01-8367-40ef-9949-a0ebc89b6610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.761623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34db01-8367-40ef-9949-a0ebc89b6610 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:58.867394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 821/1623] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/projects => generated 357 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:58.868369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.870854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 803/1624] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:58.872791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe9a7-7dc1-4cde-9926-2937d3738f24 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.873489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe9a7-7dc1-4cde-9926-2937d3738f24 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.873961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe9a7-7dc1-4cde-9926-2937d3738f24 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.881661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 804/1625] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 09:10:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:10:58.883069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe9a7-7dc1-4cde-9926-2937d3738f24 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:58.984825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe9a7-7dc1-4cde-9926-2937d3738f24 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.985655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac512d8f-b8f9-4769-8a5d-018f27c23120 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:58.993488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee80c9e-bb0b-46d3-b86e-01d180aafa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.993702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:58.994380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.994570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee80c9e-bb0b-46d3-b86e-01d180aafa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:58.994671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.994859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee80c9e-bb0b-46d3-b86e-01d180aafa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:58.994973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.995270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee80c9e-bb0b-46d3-b86e-01d180aafa63 admin admin] PATH_INFO: `/v3/projects/ffd6908aa603445aafb27e3ff1987f1c/users/a2e2791df64e495d94f10dca5e124682/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:58.995661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:58.997701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.013726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee80c9e-bb0b-46d3-b86e-01d180aafa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd6908aa603445aafb27e3ff1987f1c, user_id=a2e2791df64e495d94f10dca5e124682, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.016506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee80c9e-bb0b-46d3-b86e-01d180aafa63 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.066210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:59.081114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 805/1626] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:10:58 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:10:59.083414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.103458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0ed3a-a7d4-4d7d-b719-1f52e6ad1651 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.110090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.111355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.111820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.112294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.115254 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.117937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.130726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 822/1627] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:58 2022] PUT /identity/v3/projects/ffd6908aa603445aafb27e3ff1987f1c/users/a2e2791df64e495d94f10dca5e124682/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:59.135085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 806/1628] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:59.135085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.139340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.139646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.139975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.147348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298b8db-7368-49a7-932e-623823406cb3 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.174585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:59.175987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:59.228818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.229637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.229991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.230332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.231181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.233073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.253099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 807/1629] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:59.253099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.264710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0f79-689b-4e22-b962-48546d6ff006 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.266043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 823/1630] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:10:59.266824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.270881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.271663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.272038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.272659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.273311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.275008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.281104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f24e79-98da-4b5e-9ab9-f84470dd8cbf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.287434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.289564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.289843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.290125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] PATH_INFO: `/v3/projects/1429ed6c2556484ea03bbc2c6c706e1a/users/e2157cca51ed4595801e4c3522430b8c/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.293650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 808/1631] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:59.294570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.307695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130c33-92fc-4e8d-8a50-a13c16131750 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.313794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.315148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.315573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.315926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] PATH_INFO: `/v3/projects/54de77525bc14e13b7e2fd06cf3cd8ce/users/4849da71c2184384be5f5fdfdcb2a517/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.318898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1429ed6c2556484ea03bbc2c6c706e1a, user_id=e2157cca51ed4595801e4c3522430b8c, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.322709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.335595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54de77525bc14e13b7e2fd06cf3cd8ce, user_id=4849da71c2184384be5f5fdfdcb2a517, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.338557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.415909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 824/1632] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:59 2022] PUT /identity/v3/projects/1429ed6c2556484ea03bbc2c6c706e1a/users/e2157cca51ed4595801e4c3522430b8c/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:59.419818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.419949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 809/1633] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:59 2022] PUT /identity/v3/projects/54de77525bc14e13b7e2fd06cf3cd8ce/users/4849da71c2184384be5f5fdfdcb2a517/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:59.419949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.436560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:59.538007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ff84-eea8-4caf-93e9-207b1c93b1cf admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.559624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5add5-a807-4f3d-860a-8199e2672e2c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.566557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.568234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.569471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.569836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] PATH_INFO: `/v3/projects/ffd6908aa603445aafb27e3ff1987f1c/users/a2e2791df64e495d94f10dca5e124682/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.572629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd6908aa603445aafb27e3ff1987f1c, user_id=a2e2791df64e495d94f10dca5e124682, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.580094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.623552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 810/1634] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:59 2022] PUT /identity/v3/projects/ffd6908aa603445aafb27e3ff1987f1c/users/a2e2791df64e495d94f10dca5e124682/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:59.624880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.647214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fabfe-c16f-495d-a018-6810a443191c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.647927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fabfe-c16f-495d-a018-6810a443191c service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.648213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fabfe-c16f-495d-a018-6810a443191c service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.648489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fabfe-c16f-495d-a018-6810a443191c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.701011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:59.724844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcc27e-7079-40e0-acb9-b5fb14974363 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.730747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.732389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.732690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.733078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.734037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.736551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.753213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 811/1635] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:59.756959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.769987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69673f-1a0b-4962-bed8-88363283e1f8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.777102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.777990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.778285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.779726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fabfe-c16f-495d-a018-6810a443191c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.785353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.785353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.785925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fabfe-c16f-495d-a018-6810a443191c service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.786026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.805727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 825/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:10:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:10:59.807601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d265d-1b2f-4bac-894e-2c26cade0966 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.807601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d265d-1b2f-4bac-894e-2c26cade0966 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.808170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d265d-1b2f-4bac-894e-2c26cade0966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.834135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 812/1637] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:10:59.835179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:10:59.852336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7ce1-c8f8-4994-8681-8cd87dfbaa3c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:10:59.867867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:10:59.875456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:10:59.875456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:10:59.875637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] PATH_INFO: `/v3/projects/54de77525bc14e13b7e2fd06cf3cd8ce/users/4849da71c2184384be5f5fdfdcb2a517/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:10:59.884905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54de77525bc14e13b7e2fd06cf3cd8ce, user_id=4849da71c2184384be5f5fdfdcb2a517, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:10:59.890202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-770d265d-1b2f-4bac-894e-2c26cade0966 None None] MFA Rules not processed for user `a2e2791df64e495d94f10dca5e124682`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:10:59.891477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-770d265d-1b2f-4bac-894e-2c26cade0966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:10:59.893530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:10:59.947652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 813/1638] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:59 2022] PUT /identity/v3/projects/54de77525bc14e13b7e2fd06cf3cd8ce/users/4849da71c2184384be5f5fdfdcb2a517/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:10:59.947652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:00.090809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 826/1639] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:00.092906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391ba96-9c4a-4eb8-88c1-d150f68756e2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:00.095781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391ba96-9c4a-4eb8-88c1-d150f68756e2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:00.099558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391ba96-9c4a-4eb8-88c1-d150f68756e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:00.127058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516e96-403b-45c5-80d8-f80f6eaa007c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:00.136855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:00.137866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:00.138133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:00.138412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] PATH_INFO: `/v3/projects/1429ed6c2556484ea03bbc2c6c706e1a/users/e2157cca51ed4595801e4c3522430b8c/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:00.146141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1429ed6c2556484ea03bbc2c6c706e1a, user_id=e2157cca51ed4595801e4c3522430b8c, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:00.154773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:00.170941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0391ba96-9c4a-4eb8-88c1-d150f68756e2 None None] MFA Rules not processed for user `4849da71c2184384be5f5fdfdcb2a517`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:00.177131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0391ba96-9c4a-4eb8-88c1-d150f68756e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:00.192115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 814/1640] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:10:59 2022] PUT /identity/v3/projects/1429ed6c2556484ea03bbc2c6c706e1a/users/e2157cca51ed4595801e4c3522430b8c/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:00.192115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:00.306996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:00.360340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db5da4-676b-4912-bee2-df2542490927 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:00.367044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:00.368057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:00.368650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:00.369098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:00.393483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 827/1641] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:00.400372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:00.401063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:00.402175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:00.497792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] MFA Rules not processed for user `e2157cca51ed4595801e4c3522430b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:00.499439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:00.538781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:00.544010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:00.557785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:00.578587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 815/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:00.709413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 828/1643] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:00.757191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:00.771274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659dc94-ff0e-44bb-8d01-16578e0b1a88 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:00.785130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:00.786089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:00.786808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:00.787251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:00.814235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:00.816028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:00.834356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 816/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:00.970911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:00.996659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e454-34b2-4b3f-8c65-0e5a15c4fb01 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:01.001050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0a193-c7d6-4eee-9ccb-26c8aa29e67a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:01.001733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0a193-c7d6-4eee-9ccb-26c8aa29e67a service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:01.002499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0a193-c7d6-4eee-9ccb-26c8aa29e67a service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:01.002777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0a193-c7d6-4eee-9ccb-26c8aa29e67a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:01.022598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0a193-c7d6-4eee-9ccb-26c8aa29e67a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:01.025740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0a193-c7d6-4eee-9ccb-26c8aa29e67a service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:01.050685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 829/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:01.521266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:01.552371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f81b95-178a-47ed-aba0-7abae1c87b57 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:01.566231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:01.569355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:01.569844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:01.571592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:01.902670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd30f1-4add-477b-8d57-01a33a360326 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:01.902670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd30f1-4add-477b-8d57-01a33a360326 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:01.902670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd30f1-4add-477b-8d57-01a33a360326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:01.902670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-65bd30f1-4add-477b-8d57-01a33a360326 None None] MFA Rules not processed for user `c99330cccfea41abbb7bc5b34956c612`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:01.902670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-65bd30f1-4add-477b-8d57-01a33a360326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:01.938981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:01.938981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:01.938981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 817/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:01.938981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:01.941733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:01.943363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce90a-6257-4f56-b365-909f81292a9f service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:01.943363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:01.945595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:01.946445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:01.946940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.111591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 830/1647] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:02.119611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1c70e-6b60-4ea0-b8c4-09001b85c12d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.119916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1c70e-6b60-4ea0-b8c4-09001b85c12d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.120199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1c70e-6b60-4ea0-b8c4-09001b85c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.140971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:02.157309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:02.175994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 818/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:02.180907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-18c1c70e-6b60-4ea0-b8c4-09001b85c12d None None] MFA Rules not processed for user `c99330cccfea41abbb7bc5b34956c612`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:02.182360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-18c1c70e-6b60-4ea0-b8c4-09001b85c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:02.233512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 831/1649] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:02.245851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:02.458863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c932221-955c-49ba-94b4-f601e2cdcfd4 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:02.475871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:02.477035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.477469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.477949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.522170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:02.527762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:02.557456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae892b-2008-4004-8602-ba8a398f7257 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.557758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae892b-2008-4004-8602-ba8a398f7257 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.558045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae892b-2008-4004-8602-ba8a398f7257 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.564419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 832/1650] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 2 09:11:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:11:02.568455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 819/1651] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:02.599029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df997b-9d31-4820-a575-a6b653c4a089 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.599600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df997b-9d31-4820-a575-a6b653c4a089 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.603908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df997b-9d31-4820-a575-a6b653c4a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.647406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e4df997b-9d31-4820-a575-a6b653c4a089 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:02.648664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e4df997b-9d31-4820-a575-a6b653c4a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:02.672459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:02.695094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87d96-4494-434a-82f3-201ca54bba76 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:02.696191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 833/1652] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 2 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:02.698254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af6f2-7bb2-44f3-aa33-082a3fa6ddb2 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.698645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af6f2-7bb2-44f3-aa33-082a3fa6ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.698930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af6f2-7bb2-44f3-aa33-082a3fa6ddb2 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.700369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 834/1653] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 09:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:11:02.707939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.708165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.708443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.709214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6f154-1cb0-42a3-9f0e-f69cb994f647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:02.710056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6f154-1cb0-42a3-9f0e-f69cb994f647 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.711885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6f154-1cb0-42a3-9f0e-f69cb994f647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.712304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6f154-1cb0-42a3-9f0e-f69cb994f647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:02.732182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:02.805401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:02.805401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:02.844871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 835/1654] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:02.900328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6f154-1cb0-42a3-9f0e-f69cb994f647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:02.901756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6f154-1cb0-42a3-9f0e-f69cb994f647 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:02.942924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 820/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:02.968143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:02.983034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ec9a2-bd52-4032-8b6d-ec56cefcf3c0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:02.995131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e9a2-ad2f-416f-92c6-66f9566af59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:02.996194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e9a2-ad2f-416f-92c6-66f9566af59a service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:02.996562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e9a2-ad2f-416f-92c6-66f9566af59a service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:02.997050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e9a2-ad2f-416f-92c6-66f9566af59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:03.019096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7e9a2-ad2f-416f-92c6-66f9566af59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:03.022353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7e9a2-ad2f-416f-92c6-66f9566af59a service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:03.037906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 836/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:03.357185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43f98-e68e-43ca-bbd7-4564cfa90ce3 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:03.357394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43f98-e68e-43ca-bbd7-4564cfa90ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:03.357619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43f98-e68e-43ca-bbd7-4564cfa90ce3 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:03.359426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 821/1657] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 09:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:11:03.367501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fd86-9a99-46b2-93a8-433fee215c17 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:03.367989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fd86-9a99-46b2-93a8-433fee215c17 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:03.368430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fd86-9a99-46b2-93a8-433fee215c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:03.408938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9ae8fd86-9a99-46b2-93a8-433fee215c17 None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:03.410468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9ae8fd86-9a99-46b2-93a8-433fee215c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:03.510303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 837/1658] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:03.522891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43f98-e68e-43ca-bbd7-4564cfa90ce3 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:03.525287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-90d43f98-e68e-43ca-bbd7-4564cfa90ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:03.546021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43f98-e68e-43ca-bbd7-4564cfa90ce3 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:03.551483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceea156-f67b-43e8-afab-68580fcfe02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:03.552572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceea156-f67b-43e8-afab-68580fcfe02b service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:03.552993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceea156-f67b-43e8-afab-68580fcfe02b service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:03.556081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceea156-f67b-43e8-afab-68580fcfe02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:03.566877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceea156-f67b-43e8-afab-68580fcfe02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:03.568623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceea156-f67b-43e8-afab-68580fcfe02b service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:03.609179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 822/1659] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:05.010470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3536b-a05e-4e62-a970-7e88e812433b None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:05.010960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3536b-a05e-4e62-a970-7e88e812433b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:05.013935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3536b-a05e-4e62-a970-7e88e812433b None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:05.016791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 838/1660] 10.222.0.18 () {54 vars in 960 bytes} [Thu Jun 2 09:11:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:11:05.022494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b820ba-2495-4a7f-a07b-79b202ecf2d6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:05.023408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b820ba-2495-4a7f-a07b-79b202ecf2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:05.023844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b820ba-2495-4a7f-a07b-79b202ecf2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:05.062818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e9b820ba-2495-4a7f-a07b-79b202ecf2d6 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:05.108314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e9b820ba-2495-4a7f-a07b-79b202ecf2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:05.412103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 823/1661] 10.222.0.18 () {58 vars in 1057 bytes} [Thu Jun 2 09:11:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:05.416695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3536b-a05e-4e62-a970-7e88e812433b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:05.488550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3536b-a05e-4e62-a970-7e88e812433b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:05.521353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:05.526990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:05.527306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:05.529005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:05.534475 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:05.571129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:05.578577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:05.610864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 839/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:05.899264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:05.899566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:05.900140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:06.002502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] MFA Rules not processed for user `0d89a238fc8047cdaaac1047a675cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:06.005754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:06.233612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 824/1663] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:06.248176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:06.272350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cecfab-74b2-479f-948e-d0de665f87ff service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:06.275609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8e13-0c31-48e6-a5a4-b0f2d381f7d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:06.276509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8e13-0c31-48e6-a5a4-b0f2d381f7d4 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:06.277024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8e13-0c31-48e6-a5a4-b0f2d381f7d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:06.277497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8e13-0c31-48e6-a5a4-b0f2d381f7d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:06.288366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc8e13-0c31-48e6-a5a4-b0f2d381f7d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:06.290958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc8e13-0c31-48e6-a5a4-b0f2d381f7d4 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:06.307618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 840/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:10.520383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:10.569834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:10.674577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb49ab-fab7-435d-88d0-8d46a81bff8f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:10.675172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb49ab-fab7-435d-88d0-8d46a81bff8f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:10.675172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb49ab-fab7-435d-88d0-8d46a81bff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:10.728591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d30a48-c96c-49ab-b3c9-f7ad60b5e141 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:10.736305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4ecb49ab-fab7-435d-88d0-8d46a81bff8f None None] MFA Rules not processed for user `0d89a238fc8047cdaaac1047a675cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:10.737992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4ecb49ab-fab7-435d-88d0-8d46a81bff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:10.742696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:10.743740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:10.744106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:10.749329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] PATH_INFO: `/v3/users/ba3314db45984ace815bb76e89224506` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:10.749329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3314db45984ace815bb76e89224506)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:10.749329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:10.769158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 841/1665] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:11.051533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3314db45984ace815bb76e89224506'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:11.076555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3314db45984ace815bb76e89224506'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:11.077755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3314db45984ace815bb76e89224506'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:11.078557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3314db45984ace815bb76e89224506'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:11.169898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3314db45984ace815bb76e89224506'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:11.300655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 825/1666] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:10 2022] DELETE /identity/v3/users/ba3314db45984ace815bb76e89224506 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:11.306053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a70e6b-4ad7-4653-a728-0423ea35d058 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:11.306637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a70e6b-4ad7-4653-a728-0423ea35d058 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:11.307116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a70e6b-4ad7-4653-a728-0423ea35d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:11.342888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-64a70e6b-4ad7-4653-a728-0423ea35d058 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:11.344284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-64a70e6b-4ad7-4653-a728-0423ea35d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:11.708375 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 842/1667] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:11.761462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:11.764844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:11.773364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6d5e-8ac3-4e81-921e-2fa2d3aee120 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:11.773769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6d5e-8ac3-4e81-921e-2fa2d3aee120 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:11.774177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6d5e-8ac3-4e81-921e-2fa2d3aee120 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:11.776260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 843/1668] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 2 09:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:11:11.792640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:11.793139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:11.793568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:11.805845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:11.828174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:11.832477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:11.972176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658fedb-f1d2-40ec-8b6d-ed4bd935cdb9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:11.982223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aeb3-c6b9-4405-8e0d-19e67d824f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:11.983718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aeb3-c6b9-4405-8e0d-19e67d824f5a service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:11.985241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aeb3-c6b9-4405-8e0d-19e67d824f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:11.986707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aeb3-c6b9-4405-8e0d-19e67d824f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:12.021938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aeb3-c6b9-4405-8e0d-19e67d824f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:12.023672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aeb3-c6b9-4405-8e0d-19e67d824f5a service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:12.030068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 844/1669] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:11:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:12.038180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:12.054243 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514907e-cc4a-40ab-b0cb-363706ffd681 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:12.059200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 826/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:12.061338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:12.062261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:12.062738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:12.063150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:12.072677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:12.074499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:12.085377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 845/1671] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:12.211532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c1bb-7595-4e0b-b2ea-5b50075bec5d None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:12.211532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c1bb-7595-4e0b-b2ea-5b50075bec5d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:12.211532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c1bb-7595-4e0b-b2ea-5b50075bec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:12.275680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7f65c1bb-7595-4e0b-b2ea-5b50075bec5d None None] MFA Rules not processed for user `58b706e007fa46c7b8a69508455fcdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:12.283289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7f65c1bb-7595-4e0b-b2ea-5b50075bec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:12.354039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:12.437695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 827/1672] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:12.449696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:12.451199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:12.678563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4bac-c678-4e35-af52-1341f64d9e08 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:12.692921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:12.693667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:12.693957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:12.694273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:12.722034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:12.723840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:12.750034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 846/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:12.876876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477882e7-7fb3-4c0f-8eeb-8a2dd06b1996 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:12.877548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477882e7-7fb3-4c0f-8eeb-8a2dd06b1996 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:12.877929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477882e7-7fb3-4c0f-8eeb-8a2dd06b1996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:12.946993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-477882e7-7fb3-4c0f-8eeb-8a2dd06b1996 None None] MFA Rules not processed for user `bc0272ac06464fb7b430bc8c664208dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:12.948403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-477882e7-7fb3-4c0f-8eeb-8a2dd06b1996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:13.091569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:13.092737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:13.120474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2d00-845e-460b-8823-2898b892e13e service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:13.135727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:13.147795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:13.148151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:13.148523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] PATH_INFO: `/v3/projects/29cdecaa188244d4ad97aa428f505a4d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:13.151948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cdecaa188244d4ad97aa428f505a4d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:13.165133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:13.170746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 828/1674] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:13.181262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:13.181772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:13.182196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:13.248857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] MFA Rules not processed for user `bc0272ac06464fb7b430bc8c664208dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:13.267688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:13.295774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 829/1675] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:13.382258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:13.405405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09e4b5-e9b8-4a63-8668-2e16dd23c223 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:13.421614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:13.422299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:13.422696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:13.423383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:13.454274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:13.460344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:13.481902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 830/1676] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:13.495973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cdecaa188244d4ad97aa428f505a4d', 'request_id': 'req-b1be9dd8-dc54-461a-934a-d292b7e6cd44'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:13.536403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cdecaa188244d4ad97aa428f505a4d', 'request_id': 'req-b1be9dd8-dc54-461a-934a-d292b7e6cd44'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:13.540272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:13.542809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:13.588933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61290d-cecf-47a2-9389-40fb5ea17df0 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:13.651739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cdecaa188244d4ad97aa428f505a4d', 'request_id': 'req-b1be9dd8-dc54-461a-934a-d292b7e6cd44'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:13.678483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] The token cache is being invalidate because project 29cdecaa188244d4ad97aa428f505a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:13.680956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:13.683074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:13.685673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 847/1677] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:13 2022] DELETE /identity/v3/projects/29cdecaa188244d4ad97aa428f505a4d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:13.693330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:13.707649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:13.759274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:13.775978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:13.777110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:13.777801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:13.779949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] PATH_INFO: `/v3/users/aac67129a0da48658220b42f27a33f45` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:13.784404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac67129a0da48658220b42f27a33f45)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:13.786682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:13.959601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be9dd8-dc54-461a-934a-d292b7e6cd44 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:13.965266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:13.966595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:13.967053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:13.968157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] PATH_INFO: `/v3/users/e2157cca51ed4595801e4c3522430b8c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:13.969781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2157cca51ed4595801e4c3522430b8c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:13.971396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: WARNING py.warnings [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:11:13.971396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: warnings.warn(msg) Jun 02 09:11:13.971396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: Jun 02 09:11:13.983136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:14.055616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:14.076881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac67129a0da48658220b42f27a33f45'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.095132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac67129a0da48658220b42f27a33f45'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.096694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac67129a0da48658220b42f27a33f45'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.098313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac67129a0da48658220b42f27a33f45'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.119630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0ea8c4e9-8e28-44eb-a7ce-137d71869605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac67129a0da48658220b42f27a33f45'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.234356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 831/1678] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:13 2022] DELETE /identity/v3/users/aac67129a0da48658220b42f27a33f45 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:14.238582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:14.238992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:14.239436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:14.270415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:14.273936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:14.356165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2157cca51ed4595801e4c3522430b8c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.399753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2157cca51ed4595801e4c3522430b8c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.401698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2157cca51ed4595801e4c3522430b8c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.402792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2157cca51ed4595801e4c3522430b8c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.408456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 832/1679] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:14.425215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:14.426681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:14.451124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c3e67d7c-19b0-4cc1-b15d-e3b73a3abf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2157cca51ed4595801e4c3522430b8c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:14.572730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 848/1680] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:13 2022] DELETE /identity/v3/users/e2157cca51ed4595801e4c3522430b8c => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:14.577686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ceab-6fec-4665-9749-f1f462cf24b7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:14.749607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a3fa1-cf28-4891-8dcf-206a9241ebcc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:14.749923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a3fa1-cf28-4891-8dcf-206a9241ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:14.750199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a3fa1-cf28-4891-8dcf-206a9241ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:14.844037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bf6a3fa1-cf28-4891-8dcf-206a9241ebcc None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:14.854036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:14.854731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:14.855020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:14.856088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bf6a3fa1-cf28-4891-8dcf-206a9241ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:14.860774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:14.870556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:14.978790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:15.058311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 849/1681] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:11:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:15.138704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:15.141034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:15.182318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 833/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:15.275055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:15.275377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:15.275652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:15.322447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] MFA Rules not processed for user `bc0272ac06464fb7b430bc8c664208dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:15.324259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:15.413725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:15.485816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 850/1683] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:15.546867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:15.549032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:15.688452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277df7b-25e7-4517-84ed-bb8b9c67f023 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:15.693674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6897138-0176-4222-9a12-659791564a92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:15.694342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897138-0176-4222-9a12-659791564a92 service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:15.694770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897138-0176-4222-9a12-659791564a92 service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:15.695055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897138-0176-4222-9a12-659791564a92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:15.707429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897138-0176-4222-9a12-659791564a92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:15.709317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897138-0176-4222-9a12-659791564a92 service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:15.734248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 834/1684] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:11:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:11:16.331078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:16.333298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:16.378420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb60b0-717f-4e8a-ae3a-e34ff4d2f82d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:16.414363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:16.416232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:16.419052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:16.419679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] PATH_INFO: `/v3/projects/1429ed6c2556484ea03bbc2c6c706e1a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:16.423867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1429ed6c2556484ea03bbc2c6c706e1a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:16.426099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:16.692207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1429ed6c2556484ea03bbc2c6c706e1a', 'request_id': 'req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:16.715730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1429ed6c2556484ea03bbc2c6c706e1a', 'request_id': 'req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:16.860266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1429ed6c2556484ea03bbc2c6c706e1a', 'request_id': 'req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:16.876034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] The token cache is being invalidate because project 1429ed6c2556484ea03bbc2c6c706e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:16.876462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:16.877852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-42cb26ba-1b7e-4c95-b4a3-f59aaa19bb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:16.880455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 851/1685] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:16 2022] DELETE /identity/v3/projects/1429ed6c2556484ea03bbc2c6c706e1a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:16.889723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:16.890425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:16.890425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:16.924546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:16.930874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:17.084626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 835/1686] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:17.092979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:17.097828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:17.097828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:17.173677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:17.179424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:17.244576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:17.251776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03d9c-56c2-4bd0-b7d2-b4bdd38f0d3f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:17.252248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:17.281001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 852/1687] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:17.282074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:17.381953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:17.381953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:17.381953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:17.381953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] PATH_INFO: `/v3/projects/783b51e86d404ac5af434056d55e797f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:17.383986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] RBAC: Authorizing `identity:delete_project(project_id=783b51e86d404ac5af434056d55e797f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:17.383986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: WARNING py.warnings [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:11:17.383986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: warnings.warn(msg) Jun 02 09:11:17.383986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: Jun 02 09:11:17.383986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:17.384529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c15c0-8dc7-4724-8bd9-b971b9e36aa2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:17.384529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:17.384529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:17.384529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:17.385889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:17.385889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:17.385889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:17.385889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:17.392859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 853/1688] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:11:17.393834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:17.412101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1b19f-27bd-4b9e-860e-735ce4a34c94 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:17.419567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beedd0-8e6b-4607-9d48-d1fd50be4fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:17.421395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beedd0-8e6b-4607-9d48-d1fd50be4fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:17.421884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beedd0-8e6b-4607-9d48-d1fd50be4fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:17.422562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beedd0-8e6b-4607-9d48-d1fd50be4fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:17.424476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beedd0-8e6b-4607-9d48-d1fd50be4fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:17.428236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beedd0-8e6b-4607-9d48-d1fd50be4fd9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:17.817296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 854/1689] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:17.822261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bebdf2-dfeb-4265-b677-7b92c73ebe79 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:17.828822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bebdf2-dfeb-4265-b677-7b92c73ebe79 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:17.829418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bebdf2-dfeb-4265-b677-7b92c73ebe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:17.895974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783b51e86d404ac5af434056d55e797f', 'request_id': 'req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:17.901859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:17.961430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f7bebdf2-dfeb-4265-b677-7b92c73ebe79 None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:17.965038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f7bebdf2-dfeb-4265-b677-7b92c73ebe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:17.967261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783b51e86d404ac5af434056d55e797f', 'request_id': 'req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:18.060625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783b51e86d404ac5af434056d55e797f', 'request_id': 'req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:18.107598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] The token cache is being invalidate because project 783b51e86d404ac5af434056d55e797f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:18.107893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:18.115014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:18.128435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 836/1690] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:17 2022] DELETE /identity/v3/projects/783b51e86d404ac5af434056d55e797f => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:18.133419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:18.140989 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:18.156990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 855/1691] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jun 2 09:11:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:18.171070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e7ae-098f-4d65-97a7-0ae336289d1d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.171697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e7ae-098f-4d65-97a7-0ae336289d1d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.171807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e7ae-098f-4d65-97a7-0ae336289d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.205888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b889e7ae-098f-4d65-97a7-0ae336289d1d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:18.235567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b889e7ae-098f-4d65-97a7-0ae336289d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:18.363868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:18.398108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5d1a-bcbf-480c-a6cd-fa7800d4869e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:18.548087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 856/1692] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:18.561653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.562157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.562770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.600107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:18.602337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:18.616091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 857/1693] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:18.617365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:18.633982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:18.634761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.645114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.645114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.645114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:18.645114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:18.650128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691464a-4b22-42ee-9a8b-7d13a5a498d8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:18.657846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:18.658789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.659579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.662111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.665078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:18.665593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:18.673811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:18.702951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 858/1694] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:18.708349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:18.708349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:18.772333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437fe5c-c2f4-46ae-a746-4b1927825a64 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:18.789414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:18.792342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.792642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.792941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.823646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:18.825123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:18.857647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 837/1695] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:18 2022] POST /identity/v3/users => generated 293 bytes in 727 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:18.862291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:18.867663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 859/1696] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:18.868919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:18.905575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187f2d-a84f-4191-aa70-deb369aac066 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:18.912103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd48a5-0aba-4ca2-9b7b-591aba95b7b8 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:18.942039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:18.942039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.942039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.942340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:18.942441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.942532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:18.942618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:18.942691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:18.942691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:18.945730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:18.949536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:18.950534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:18.968007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 860/1697] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:18.972121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:18.986553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d0d42-1d88-466e-af7d-90d85d952a92 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.007491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.008656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.008656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.008859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.009486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.011423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.031507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 861/1698] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:19.035458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.047712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bba6f3-f331-45a6-957d-4bef495e1fe8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.053614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119cf2-02f2-4d87-a020-e03d3759d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.057123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119cf2-02f2-4d87-a020-e03d3759d29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.057123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119cf2-02f2-4d87-a020-e03d3759d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.057123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119cf2-02f2-4d87-a020-e03d3759d29d admin admin] PATH_INFO: `/v3/projects/0ca6cf434fd64a1a954322a73cfbadf5/users/565ae2a5ee5346beb471909c3cad326f/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.076592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119cf2-02f2-4d87-a020-e03d3759d29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca6cf434fd64a1a954322a73cfbadf5, user_id=565ae2a5ee5346beb471909c3cad326f, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.079464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119cf2-02f2-4d87-a020-e03d3759d29d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.091136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 838/1699] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:18 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:19.095068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.214426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:19.237279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac45e3-db16-46f6-9ed7-f05199375c39 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.243384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.245181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.245656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.246086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.247010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.250145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.266396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 862/1700] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:19 2022] PUT /identity/v3/projects/0ca6cf434fd64a1a954322a73cfbadf5/users/565ae2a5ee5346beb471909c3cad326f/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:19.289040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.289857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.290250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.351131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] MFA Rules not processed for user `565ae2a5ee5346beb471909c3cad326f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:19.353893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:19.446345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 839/1701] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:19 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:19.447887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.469774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cba98-56ab-410d-a213-377fc4868987 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.495639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 863/1702] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:19.500135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.674364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.675065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.676698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.676993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.678279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.681210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.707123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 840/1703] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:19.708501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde9cd-e290-488b-9831-a57e02ab814a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.709794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.722859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.723581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.723884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.725068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.725682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.727643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:19.728545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0bb7-0ca7-441a-98eb-ba2ea136dce0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.731067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.745475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.746189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.746479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.746755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.747553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.751196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.769144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 841/1704] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:19.773577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.785051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a748ba-86f9-46c4-aef3-773781a67903 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:19.790834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e34567-7d61-4c42-a117-548533d3ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:19.794348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e34567-7d61-4c42-a117-548533d3ac8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.794348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e34567-7d61-4c42-a117-548533d3ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.794348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e34567-7d61-4c42-a117-548533d3ac8a admin admin] PATH_INFO: `/v3/projects/e021cf43509449b88c5d1a88b19055f5/users/1dff08414fa44d35857a77e53935609a/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:19.834586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e34567-7d61-4c42-a117-548533d3ac8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e021cf43509449b88c5d1a88b19055f5, user_id=1dff08414fa44d35857a77e53935609a, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:19.834586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e34567-7d61-4c42-a117-548533d3ac8a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:19.862872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 864/1705] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:19 2022] POST /identity/v3/projects => generated 387 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:19.868152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:19.955085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 842/1706] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:19 2022] PUT /identity/v3/projects/e021cf43509449b88c5d1a88b19055f5/users/1dff08414fa44d35857a77e53935609a/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:19.965820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:19.966331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:19.966978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:20.021550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12202-1369-47b3-8732-42c9d31cf0f7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:20.061605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] MFA Rules not processed for user `1dff08414fa44d35857a77e53935609a`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:20.066732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:20.261071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:20.273085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:20.278308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:20.279062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:20.283076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:20.292878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:20.350786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 843/1707] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:20.423168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 865/1708] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:19 2022] POST /identity/v3/users => generated 300 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:20.425178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:20.448215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b4187-da48-40bb-bc3b-8747fae58264 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:20.458475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:20.461717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:20.462048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:20.465455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:20.465455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:20.466566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:20.507051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 844/1709] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:20.514356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:20.525499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5dac-21cc-493a-a659-51a709731cb6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:20.546262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:20.558084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:20.558084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:20.558084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] PATH_INFO: `/v3/projects/32ec4a826dd842ea8b7f447b5150c674/users/b462b7e7c24d4419b545d7b74cfcd8af/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:20.642495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:20.644559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:20.661969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ec4a826dd842ea8b7f447b5150c674, user_id=b462b7e7c24d4419b545d7b74cfcd8af, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:20.667325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:20.785264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 866/1710] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:20 2022] PUT /identity/v3/projects/32ec4a826dd842ea8b7f447b5150c674/users/b462b7e7c24d4419b545d7b74cfcd8af/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:20.790099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:20.910293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5655b6-6bd4-47a6-87e1-31512875b818 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:20.929013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:20.944500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:20.993257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fe9e7-1a55-4b0d-8969-1ef77ea4fc81 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:21.022749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:21.025059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:21.025059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:21.025059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:21.025059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:21.027275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:21.071351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 867/1711] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:21.072436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:21.100040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76993698-d146-46cf-b2fa-1f2a555c9d08 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:21.113233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d5fd-f4aa-4012-b845-73e298ef9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:21.116528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d5fd-f4aa-4012-b845-73e298ef9db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:21.118931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d5fd-f4aa-4012-b845-73e298ef9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:21.120799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d5fd-f4aa-4012-b845-73e298ef9db2 admin admin] PATH_INFO: `/v3/projects/32ec4a826dd842ea8b7f447b5150c674/users/b462b7e7c24d4419b545d7b74cfcd8af/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:21.128859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d5fd-f4aa-4012-b845-73e298ef9db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ec4a826dd842ea8b7f447b5150c674, user_id=b462b7e7c24d4419b545d7b74cfcd8af, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:21.132693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d5fd-f4aa-4012-b845-73e298ef9db2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:21.151136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d71798-286c-4901-9ccf-e039eb63a6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:21.152400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 868/1712] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:21 2022] PUT /identity/v3/projects/32ec4a826dd842ea8b7f447b5150c674/users/b462b7e7c24d4419b545d7b74cfcd8af/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:21.161542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d71798-286c-4901-9ccf-e039eb63a6e6 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:21.166231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d71798-286c-4901-9ccf-e039eb63a6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:21.166231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d71798-286c-4901-9ccf-e039eb63a6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:21.166400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:21.166400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:21.166400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:21.222938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] MFA Rules not processed for user `b462b7e7c24d4419b545d7b74cfcd8af`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:21.224857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:21.313833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d71798-286c-4901-9ccf-e039eb63a6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:21.315673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d71798-286c-4901-9ccf-e039eb63a6e6 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:21.339228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 845/1713] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:21.341446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:21.341747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:21.342034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:21.381990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] MFA Rules not processed for user `58b706e007fa46c7b8a69508455fcdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:21.383269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:21.403181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 869/1714] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:21.441352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:21.462093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:21.549367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 846/1715] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:21.715354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e336-93fd-4e4e-ae27-d26fe9696289 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:21.735754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5fb8-81f8-4119-b528-479bcba68a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:21.736588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5fb8-81f8-4119-b528-479bcba68a3a service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:21.738387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5fb8-81f8-4119-b528-479bcba68a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:21.739111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5fb8-81f8-4119-b528-479bcba68a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:21.785789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a5fb8-81f8-4119-b528-479bcba68a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:21.788499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a5fb8-81f8-4119-b528-479bcba68a3a service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:21.825139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 870/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:21.879943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:21.884544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:22.188754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640955a-88ca-45b9-bfb7-4bcae8ce23ce None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:22.201389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:22.221743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:22.222175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:22.222710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] PATH_INFO: `/v3/users/565ae2a5ee5346beb471909c3cad326f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:22.229779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=565ae2a5ee5346beb471909c3cad326f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:22.237330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:22.571952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565ae2a5ee5346beb471909c3cad326f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:22.586560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565ae2a5ee5346beb471909c3cad326f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:22.587488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565ae2a5ee5346beb471909c3cad326f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:22.591694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565ae2a5ee5346beb471909c3cad326f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:22.644650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4654b06d-5be7-4385-9701-8581f247c6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565ae2a5ee5346beb471909c3cad326f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:22.763290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 847/1717] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:21 2022] DELETE /identity/v3/users/565ae2a5ee5346beb471909c3cad326f => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:22.768373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:22.770464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:22.771613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:22.794705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34916f5-9dec-4444-9b8e-0397aeab77ed None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:22.795197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34916f5-9dec-4444-9b8e-0397aeab77ed None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:22.795705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34916f5-9dec-4444-9b8e-0397aeab77ed None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:22.797409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 848/1718] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:11:22.837935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:22.851574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:22.863767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:22.864368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:22.864917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:22.894174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:22.898313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:22.997081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:23.018665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 849/1719] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:23.029275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 871/1720] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:23.093178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:23.094874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:23.155576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:23.227762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88f5f0-710a-4f2f-a063-a5e07abf47e6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:23.241568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:23.242622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:23.243074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:23.243501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:23.266924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:23.276137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:23.301435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 850/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:24.063188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:24.064706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:24.094538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f946992-11e0-48f2-880d-e0f0d045bd1c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:24.111720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:24.112406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:24.112692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:24.112991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:24.137182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:24.139471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:24.157438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 872/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:24.915496 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:24.917820 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:24.949007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f65b3-eacc-41dc-989e-84c10894099a service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:24.964363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa74195-c921-4601-a879-66645802017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:24.966138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa74195-c921-4601-a879-66645802017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:24.966428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa74195-c921-4601-a879-66645802017d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:24.966859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa74195-c921-4601-a879-66645802017d admin admin] PATH_INFO: `/v3/projects/0ca6cf434fd64a1a954322a73cfbadf5` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:24.970248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa74195-c921-4601-a879-66645802017d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca6cf434fd64a1a954322a73cfbadf5)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:24.972834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa74195-c921-4601-a879-66645802017d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:25.183094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca6cf434fd64a1a954322a73cfbadf5', 'request_id': 'req-0aa74195-c921-4601-a879-66645802017d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:25.196810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca6cf434fd64a1a954322a73cfbadf5', 'request_id': 'req-0aa74195-c921-4601-a879-66645802017d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:25.403443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca6cf434fd64a1a954322a73cfbadf5', 'request_id': 'req-0aa74195-c921-4601-a879-66645802017d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:25.415179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0aa74195-c921-4601-a879-66645802017d admin admin] The token cache is being invalidate because project 0ca6cf434fd64a1a954322a73cfbadf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:25.415511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:25.422054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:25.430026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 851/1723] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:24 2022] DELETE /identity/v3/projects/0ca6cf434fd64a1a954322a73cfbadf5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:25.434591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:25.476980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cb369-5378-40dd-9d74-45ac246b2db2 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:25.618499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:25.620612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:25.748785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:25.749988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:25.755972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:25.755972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] PATH_INFO: `/v3/users/b462b7e7c24d4419b545d7b74cfcd8af` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:25.755972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b462b7e7c24d4419b545d7b74cfcd8af)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:25.758351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:25.836929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa74195-c921-4601-a879-66645802017d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:25.853131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:25.854521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:25.854806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:25.855104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] PATH_INFO: `/v3/users/1dff08414fa44d35857a77e53935609a` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:25.858830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dff08414fa44d35857a77e53935609a)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:25.860969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:26.011319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b462b7e7c24d4419b545d7b74cfcd8af'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.021870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b462b7e7c24d4419b545d7b74cfcd8af'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.022786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b462b7e7c24d4419b545d7b74cfcd8af'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.024924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b462b7e7c24d4419b545d7b74cfcd8af'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.065857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-951b01ca-5cfb-4502-8eec-9dbab80f8c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b462b7e7c24d4419b545d7b74cfcd8af'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.085884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:26.107423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dff08414fa44d35857a77e53935609a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.135511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dff08414fa44d35857a77e53935609a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.139144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dff08414fa44d35857a77e53935609a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.140026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dff08414fa44d35857a77e53935609a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.158732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 873/1724] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:25 2022] DELETE /identity/v3/users/b462b7e7c24d4419b545d7b74cfcd8af => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:26.218919 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dff08414fa44d35857a77e53935609a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:26.348105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 852/1725] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:25 2022] DELETE /identity/v3/users/1dff08414fa44d35857a77e53935609a => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:26.349441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:26.349734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:26.350011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:26.379623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:26.398170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:26.479628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:26.494366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 874/1726] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:26.538908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:26.541738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:26.701288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ec9b2-caa4-4b27-94a0-aa471cdf6ca5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:26.707071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:26.708115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:26.708341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:26.708650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:26.719959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:26.721430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:26.734863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 853/1727] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:27.539373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:27.540831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:27.570023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc06332-343f-4ad7-ab53-c21bae1c3301 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:27.596481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:27.599709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:27.602055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:27.604064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] PATH_INFO: `/v3/projects/32ec4a826dd842ea8b7f447b5150c674` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:27.613071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ec4a826dd842ea8b7f447b5150c674)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:27.620650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:27.852661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ec4a826dd842ea8b7f447b5150c674', 'request_id': 'req-3cdf2833-8085-44ee-be29-08b5f77509f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:27.864956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ec4a826dd842ea8b7f447b5150c674', 'request_id': 'req-3cdf2833-8085-44ee-be29-08b5f77509f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:27.967014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:27.967014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:27.986695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ec4a826dd842ea8b7f447b5150c674', 'request_id': 'req-3cdf2833-8085-44ee-be29-08b5f77509f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.034017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] The token cache is being invalidate because project 32ec4a826dd842ea8b7f447b5150c674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:28.035522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197247a5-9298-4823-96b1-018266c556f9 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:28.036125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.038168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3cdf2833-8085-44ee-be29-08b5f77509f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.058315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 875/1728] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:27 2022] DELETE /identity/v3/projects/32ec4a826dd842ea8b7f447b5150c674 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:28.063107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c4832-e8a4-41e8-88ba-25243be40d1f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.064867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c4832-e8a4-41e8-88ba-25243be40d1f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.065311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c4832-e8a4-41e8-88ba-25243be40d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.127874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-726c4832-e8a4-41e8-88ba-25243be40d1f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:28.129391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-726c4832-e8a4-41e8-88ba-25243be40d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:28.157707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:28.159075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.161096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.161664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] PATH_INFO: `/v3/projects/e021cf43509449b88c5d1a88b19055f5` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.163949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e021cf43509449b88c5d1a88b19055f5)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:28.166237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:28.258026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 876/1729] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:28.260092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.260590 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.261093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.312727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:28.318976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:28.342368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 877/1730] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:28.348380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:28.368879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e021cf43509449b88c5d1a88b19055f5', 'request_id': 'req-5ce74243-eab7-45f8-b282-6f94553b5029'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.370865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1cd81-38a6-4366-93f5-37bdfacfe2b7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:28.397756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e021cf43509449b88c5d1a88b19055f5', 'request_id': 'req-5ce74243-eab7-45f8-b282-6f94553b5029'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.468837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:28.469552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.469857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.470156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.476720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:28.477125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:28.479180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:28.500229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 878/1731] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:28.504883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:28.521865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e021cf43509449b88c5d1a88b19055f5', 'request_id': 'req-5ce74243-eab7-45f8-b282-6f94553b5029'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.524886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:28.539963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] The token cache is being invalidate because project e021cf43509449b88c5d1a88b19055f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:28.540271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.543637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5ce74243-eab7-45f8-b282-6f94553b5029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:28.548753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 854/1732] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:27 2022] DELETE /identity/v3/projects/e021cf43509449b88c5d1a88b19055f5 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:28.550734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd59cd-6210-4717-9a9c-ad97d92e97bf None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.551029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd59cd-6210-4717-9a9c-ad97d92e97bf None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.551344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd59cd-6210-4717-9a9c-ad97d92e97bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.567684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ceb36-db14-4531-a459-0318bbee3e45 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:28.578407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:28.579446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.585008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.585008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.585008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:28.595148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:28.596626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-50fd59cd-6210-4717-9a9c-ad97d92e97bf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:28.597757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-50fd59cd-6210-4717-9a9c-ad97d92e97bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:28.613433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:28.630091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 855/1733] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:28.632164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.632464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.636615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.661369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:28.663142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:28.681761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 856/1734] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:28.683026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:28.694276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8391f-3019-4c74-98e7-b348b64f6c68 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:28.700011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:28.701102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.701537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.702016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.702938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:28.703768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:28.705623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:28.713445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 879/1735] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:28.715173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:28.717215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:28.728951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 857/1736] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:28.740906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:28.752396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b063d-412a-4c67-8f94-b1887647859f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:28.946708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:28.947428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.947715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.947990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.948692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:28.950748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:28.959983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06f06d-430d-4b13-bf86-206af73e3cee admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:28.973252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:28.974828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:28.975323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:28.975885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:28.977089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:28.979319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.068888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 858/1737] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/projects => generated 369 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:29.074426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.104711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 880/1738] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:28 2022] POST /identity/v3/users => generated 294 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:29.106589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.136380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b364b-dda5-477b-8db1-2e601749c829 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.207843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf813d-7c4a-4341-9037-2ee573ce96a5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.214448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480384c0-b934-43a4-9b23-1781cc7be70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.215348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480384c0-b934-43a4-9b23-1781cc7be70a admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.215771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480384c0-b934-43a4-9b23-1781cc7be70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.222393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480384c0-b934-43a4-9b23-1781cc7be70a admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.222393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480384c0-b934-43a4-9b23-1781cc7be70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.222393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480384c0-b934-43a4-9b23-1781cc7be70a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.309076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.310322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.311000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.311618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.312775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.314604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.332845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 881/1739] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:29.335079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.359741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a2b4e-1e5d-4388-951f-3c42ccb25ba2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.370921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 859/1740] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:29 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:29.371901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421103-8b41-4a93-9e52-38a31d231f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.373705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b433-f78d-4ec8-b50d-d20df497c0ee None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.374203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421103-8b41-4a93-9e52-38a31d231f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.374995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421103-8b41-4a93-9e52-38a31d231f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.375547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421103-8b41-4a93-9e52-38a31d231f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.376417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b433-f78d-4ec8-b50d-d20df497c0ee None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.376720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b433-f78d-4ec8-b50d-d20df497c0ee None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.378821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17421103-8b41-4a93-9e52-38a31d231f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.379810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 860/1741] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:11:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:11:29.381783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17421103-8b41-4a93-9e52-38a31d231f8c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.383813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b433-f78d-4ec8-b50d-d20df497c0ee None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.402771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b433-f78d-4ec8-b50d-d20df497c0ee None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.416258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.426646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.426646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.426646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.426646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.426646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.447806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 882/1742] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:29.451697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.452990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.453636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.487338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 861/1743] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:29.488328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.506819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:29.509652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:29.545253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb059eda-c769-4e49-a99a-f143728ca413 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.555471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.562658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.562992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.563340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] PATH_INFO: `/v3/projects/85c9fecdddf248b48aa0d374a95f4f92/users/9372d7b7658c4aa78e38c742dd15130d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.602270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:29.604665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c9fecdddf248b48aa0d374a95f4f92, user_id=9372d7b7658c4aa78e38c742dd15130d, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.610011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.636893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 883/1744] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:29.638677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.658841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472aaa-5462-4e21-b035-dcd2ab880b03 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.662548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.663773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.664174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.664555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.665479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.667604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.683565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 884/1745] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:29.687983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.712517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b22457-2ab8-4cd2-9aec-bfefe26f3f95 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:29.726489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c358-73bf-4a9e-8b3a-9f765cc406e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:29.727810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c358-73bf-4a9e-8b3a-9f765cc406e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:29.727908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c358-73bf-4a9e-8b3a-9f765cc406e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:29.730229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c358-73bf-4a9e-8b3a-9f765cc406e2 admin admin] PATH_INFO: `/v3/projects/2555382a89af48dc997351e59b8f13d1/users/d40c8fc9256e42d4b6a7ccef6883beb6/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:29.775774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060c358-73bf-4a9e-8b3a-9f765cc406e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2555382a89af48dc997351e59b8f13d1, user_id=d40c8fc9256e42d4b6a7ccef6883beb6, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:29.778485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060c358-73bf-4a9e-8b3a-9f765cc406e2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:29.813301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 862/1746] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:29 2022] PUT /identity/v3/projects/85c9fecdddf248b48aa0d374a95f4f92/users/9372d7b7658c4aa78e38c742dd15130d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:29.813301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:29.813301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:29.822185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:30.053294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751bbb-511d-490c-af43-568eb293d57e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:30.064939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 885/1747] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:29 2022] PUT /identity/v3/projects/2555382a89af48dc997351e59b8f13d1/users/d40c8fc9256e42d4b6a7ccef6883beb6/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:30.066343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.066639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.066920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.174643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] MFA Rules not processed for user `9372d7b7658c4aa78e38c742dd15130d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:30.175932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:30.186120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec3a93-80ec-4f42-b2b0-5d26b649d691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:30.186795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec3a93-80ec-4f42-b2b0-5d26b649d691 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.187367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec3a93-80ec-4f42-b2b0-5d26b649d691 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.187790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec3a93-80ec-4f42-b2b0-5d26b649d691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.199272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec3a93-80ec-4f42-b2b0-5d26b649d691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:30.201093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec3a93-80ec-4f42-b2b0-5d26b649d691 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:30.219871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 863/1748] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:30.221565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.222033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.232011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.327352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 886/1749] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:30.327352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:30.329605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] MFA Rules not processed for user `d40c8fc9256e42d4b6a7ccef6883beb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:30.331081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:30.537054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 864/1750] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:30.550449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:30.576782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c6537-bae9-472d-96fa-a687e62a975a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:30.592619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48281c-8377-4f18-9a23-289d4ae82eae None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:30.597360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:30.600835 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.601125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.604588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.606526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:30.612694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:30.618335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:30.619027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.619369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.619650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.620360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:30.633328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:30.806201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 887/1751] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:30 2022] POST /identity/v3/projects => generated 385 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:30.810361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:30.818545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 865/1752] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:30 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:30.823164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:30.946711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc070920-2c91-498d-98db-b7b70f435b7c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:30.947481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a224f-2c49-4ff0-942e-7472eca530d7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:30.954579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:30.955697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.956542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.957155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.958310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:30.960072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:30.960837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:30.961124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:30.961404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:30.962117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:30.962716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:30.968535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.067275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 888/1753] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:30 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:31.070587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.080931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5017c5-92f4-462a-ba41-bb2ab8bff722 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.085974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.086651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.086941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.087224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.087999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.089641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.101219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 889/1754] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:31.101631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:31.104668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.115294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d662c1-a715-4451-8b76-fbcca3aa1a01 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.120247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.124379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.124379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.124379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] PATH_INFO: `/v3/projects/901e4bdc1fbf4c9c8a6784e3c5efa10d/users/a3e4b7138a9a4fd7988aa56faaa03960/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.127583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 866/1755] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:30 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:31.132200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.138941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=901e4bdc1fbf4c9c8a6784e3c5efa10d, user_id=a3e4b7138a9a4fd7988aa56faaa03960, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.141628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.142173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce056f7-4081-4bed-ae83-9682e96d3e69 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.146986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.152279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.152279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.152279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.152279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.152279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.160887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 867/1756] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:31.165036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.175505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd6dbc-f786-4d52-a080-0390f20d880a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.181150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.182049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.182359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.182692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] PATH_INFO: `/v3/projects/e1a7f6dd132549299e2a4c99d0882cf4/users/e413597ea4f84e0bbffb889adf085075/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.203268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a7f6dd132549299e2a4c99d0882cf4, user_id=e413597ea4f84e0bbffb889adf085075, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.203268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.232051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 890/1757] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:31 2022] PUT /identity/v3/projects/901e4bdc1fbf4c9c8a6784e3c5efa10d/users/a3e4b7138a9a4fd7988aa56faaa03960/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:31.236126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.287744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 868/1758] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:31 2022] PUT /identity/v3/projects/e1a7f6dd132549299e2a4c99d0882cf4/users/e413597ea4f84e0bbffb889adf085075/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:31.295177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.308601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196eb9cf-2cd8-4ca0-8711-8b918b854c9c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.360547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47964f69-6366-4e94-a14e-381b795d0866 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.367393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.368158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.368773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.368773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.369346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.371092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.375416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.376449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.376813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.377216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.378073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.380313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.386303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 869/1759] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:31.387604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.394172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 891/1760] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:31.397323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.401573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8fc77-10f6-4179-8b1a-5dcac96b3b4d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.406887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd5718-f030-463c-9393-d88a0c240f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.407827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5718-f030-463c-9393-d88a0c240f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.408119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5718-f030-463c-9393-d88a0c240f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.408409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5718-f030-463c-9393-d88a0c240f3c admin admin] PATH_INFO: `/v3/projects/e1a7f6dd132549299e2a4c99d0882cf4/users/e413597ea4f84e0bbffb889adf085075/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.408697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ca5e1-c0fd-4e2e-b503-4c225bd37b8a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.410578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5718-f030-463c-9393-d88a0c240f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a7f6dd132549299e2a4c99d0882cf4, user_id=e413597ea4f84e0bbffb889adf085075, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.413879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5718-f030-463c-9393-d88a0c240f3c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.415977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b05b-4980-4527-818b-5818b42dbdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.417613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b05b-4980-4527-818b-5818b42dbdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.417912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b05b-4980-4527-818b-5818b42dbdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.418209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b05b-4980-4527-818b-5818b42dbdd3 admin admin] PATH_INFO: `/v3/projects/901e4bdc1fbf4c9c8a6784e3c5efa10d/users/a3e4b7138a9a4fd7988aa56faaa03960/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.422380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b05b-4980-4527-818b-5818b42dbdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901e4bdc1fbf4c9c8a6784e3c5efa10d, user_id=a3e4b7138a9a4fd7988aa56faaa03960, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.427014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 870/1761] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:31 2022] PUT /identity/v3/projects/e1a7f6dd132549299e2a4c99d0882cf4/users/e413597ea4f84e0bbffb889adf085075/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:31.427766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b05b-4980-4527-818b-5818b42dbdd3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.437694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.438028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.438276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.453184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 892/1762] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:31 2022] PUT /identity/v3/projects/901e4bdc1fbf4c9c8a6784e3c5efa10d/users/a3e4b7138a9a4fd7988aa56faaa03960/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:31.474750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.474750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.474750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.475184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] MFA Rules not processed for user `e413597ea4f84e0bbffb889adf085075`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:31.475801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:31.510294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] MFA Rules not processed for user `a3e4b7138a9a4fd7988aa56faaa03960`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:31.512225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:31.563991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 871/1763] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:31.576296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.577722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:31.611716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 893/1764] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:31.624287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:31.625867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:31.645198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58b6c-1a44-45b1-a2fd-6e273df5c2e4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.652163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.662630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.663075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.663536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.674537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.676252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.684411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:31.690701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 872/1765] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:31.712340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fda339-f13d-44bb-adba-6c9d197e9b77 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:31.720988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7084-27d9-424c-ae3b-cf96b32fa7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:31.720988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7084-27d9-424c-ae3b-cf96b32fa7cc service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:31.720988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7084-27d9-424c-ae3b-cf96b32fa7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:31.720988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7084-27d9-424c-ae3b-cf96b32fa7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:31.744082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde7084-27d9-424c-ae3b-cf96b32fa7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:31.744082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde7084-27d9-424c-ae3b-cf96b32fa7cc service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:31.755020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 894/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:31.877439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:31.918787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:32.003272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf8c1f-39be-4fc4-8a0a-2eea65ce3c2e service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:32.009345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:32.010236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:32.010527 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:32.010811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] PATH_INFO: `/v3/users/9372d7b7658c4aa78e38c742dd15130d` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:32.015862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9372d7b7658c4aa78e38c742dd15130d)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:32.022561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:32.272696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9372d7b7658c4aa78e38c742dd15130d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:32.280841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9372d7b7658c4aa78e38c742dd15130d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:32.281919 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9372d7b7658c4aa78e38c742dd15130d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:32.282721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9372d7b7658c4aa78e38c742dd15130d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:32.295823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9372d7b7658c4aa78e38c742dd15130d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:32.382207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 873/1767] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:31 2022] DELETE /identity/v3/users/9372d7b7658c4aa78e38c742dd15130d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:32.387040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:32.387764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:32.388059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:32.408183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:32.410640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:32.480526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 895/1768] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:32.491609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:32.493260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:32.585591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616c4a-41e4-462c-8a99-e1bf2f5166cd admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:32.589519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:32.592931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:32.598684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:32.598684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:32.598684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:32.609382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:32.610876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:32.621616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 874/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:32.932264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:32.934349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:32.946455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1c08-ef5c-4f69-844d-5e837d97328a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:32.951097 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:32.952014 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:32.952302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:32.952585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] PATH_INFO: `/v3/users/b899938479044bdc9be764dddf2029f1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:32.953843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b899938479044bdc9be764dddf2029f1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:32.956013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:33.109199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:33.110703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:33.123643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a860-a686-4d01-841a-0248e621e176 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:33.129298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:33.130279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:33.130738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:33.131019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] PATH_INFO: `/v3/projects/85c9fecdddf248b48aa0d374a95f4f92` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:33.132614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c9fecdddf248b48aa0d374a95f4f92)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:33.134701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:33.249548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:33.258515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b899938479044bdc9be764dddf2029f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.262787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c9fecdddf248b48aa0d374a95f4f92', 'request_id': 'req-93c1b64c-0df8-4145-a753-55b552c11419'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.270582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c9fecdddf248b48aa0d374a95f4f92', 'request_id': 'req-93c1b64c-0df8-4145-a753-55b552c11419'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.274240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b899938479044bdc9be764dddf2029f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.275314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b899938479044bdc9be764dddf2029f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.276564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b899938479044bdc9be764dddf2029f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.296210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8f5bb99b-1516-4664-be25-270ad56abc7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b899938479044bdc9be764dddf2029f1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.351928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c9fecdddf248b48aa0d374a95f4f92', 'request_id': 'req-93c1b64c-0df8-4145-a753-55b552c11419'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.365629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] The token cache is being invalidate because project 85c9fecdddf248b48aa0d374a95f4f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:33.365975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.366581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.368734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 875/1770] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:33 2022] DELETE /identity/v3/projects/85c9fecdddf248b48aa0d374a95f4f92 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:33.372961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:33.374482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:33.409146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 896/1771] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:32 2022] DELETE /identity/v3/users/b899938479044bdc9be764dddf2029f1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:33.414147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:33.414315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:33.415137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:33.443630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:33.444609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:33.444961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:33.480715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b64c-0df8-4145-a753-55b552c11419 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:33.521520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 897/1772] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:33.538422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:33.539883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:33.591118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:33.592296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:33.592296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:33.592598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] PATH_INFO: `/v3/users/a3e4b7138a9a4fd7988aa56faaa03960` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:33.593841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e4b7138a9a4fd7988aa56faaa03960)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:33.595844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:33.639395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84c9f9-7cb5-4be8-8148-63cdbe71f438 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:33.643191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:33.643892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:33.644177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:33.644480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:33.655385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:33.657284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:33.668010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 898/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:33.811376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e4b7138a9a4fd7988aa56faaa03960'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.836313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e4b7138a9a4fd7988aa56faaa03960'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.839683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e4b7138a9a4fd7988aa56faaa03960'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.840682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e4b7138a9a4fd7988aa56faaa03960'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.891636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e4b7138a9a4fd7988aa56faaa03960'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:33.995099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 876/1774] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:33 2022] DELETE /identity/v3/users/a3e4b7138a9a4fd7988aa56faaa03960 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:34.382214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:34.384507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:34.405993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5bc44-add2-41f3-8284-1f61c51cc04b service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:34.452938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:34.472610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:34.473501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:34.474482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:34.474816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] PATH_INFO: `/v3/projects/b7cf053fd53e4e3489101424ebd4390d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:34.476397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7cf053fd53e4e3489101424ebd4390d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:34.478473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:34.481731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:34.592144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7cf053fd53e4e3489101424ebd4390d', 'request_id': 'req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:34.605459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7cf053fd53e4e3489101424ebd4390d', 'request_id': 'req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:34.697868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7cf053fd53e4e3489101424ebd4390d', 'request_id': 'req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:34.710347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] The token cache is being invalidate because project b7cf053fd53e4e3489101424ebd4390d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:34.710773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:34.711457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:34.713106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 899/1775] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:34 2022] DELETE /identity/v3/projects/b7cf053fd53e4e3489101424ebd4390d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:34.716998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:34.718533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:34.732769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d515f-9cf5-4d83-93c6-b17b1320d835 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:34.737271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:34.743341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:34.821406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:34.822524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:34.822958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:34.823944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] PATH_INFO: `/v3/users/4849da71c2184384be5f5fdfdcb2a517` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:34.825415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4849da71c2184384be5f5fdfdcb2a517)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:34.826708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105ca9e-ca67-4ca9-bc8f-6bef39a28a9b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:34.828689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:34.832412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:34.834055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:34.834558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:34.835485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] PATH_INFO: `/v3/projects/901e4bdc1fbf4c9c8a6784e3c5efa10d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:34.840387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=901e4bdc1fbf4c9c8a6784e3c5efa10d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:34.840387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:35.877674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901e4bdc1fbf4c9c8a6784e3c5efa10d', 'request_id': 'req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.885040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901e4bdc1fbf4c9c8a6784e3c5efa10d', 'request_id': 'req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.895816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4849da71c2184384be5f5fdfdcb2a517'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.904379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4849da71c2184384be5f5fdfdcb2a517'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.905140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4849da71c2184384be5f5fdfdcb2a517'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.905757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4849da71c2184384be5f5fdfdcb2a517'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.919840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cfb0c500-1416-4211-ab73-d622c01e3f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4849da71c2184384be5f5fdfdcb2a517'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.973349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901e4bdc1fbf4c9c8a6784e3c5efa10d', 'request_id': 'req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.995368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] The token cache is being invalidate because project 901e4bdc1fbf4c9c8a6784e3c5efa10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:35.995673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:35.997115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e638cac7-91d4-4f1c-b0aa-c70af7a937cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:36.004115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 900/1776] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:34 2022] DELETE /identity/v3/projects/901e4bdc1fbf4c9c8a6784e3c5efa10d => generated 0 bytes in 1267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:36.022977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.024905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.027645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.040693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 877/1777] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:34 2022] DELETE /identity/v3/users/4849da71c2184384be5f5fdfdcb2a517 => generated 0 bytes in 1324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:36.090786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:36.092748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:36.186517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 901/1778] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:36.196285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.196578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.196862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.217174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:36.219488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:36.228396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 878/1779] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:36.232756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.249246 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479103f8-3f5f-45a9-bbf9-f93ea4d60c7d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.256084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.256922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.257286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.257652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.258467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:36.258885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.260549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.271374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.273858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:36.276334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 902/1780] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:36.280417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.291662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e546-0bf1-4fe3-a4ec-8f23024b4f73 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.292455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c9b0-b361-4df0-89e7-bae373e26521 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.297519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.298518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.298943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.300486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.300486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.304580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.314612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.316036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.317053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.318703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] PATH_INFO: `/v3/users/d40c8fc9256e42d4b6a7ccef6883beb6` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.321597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40c8fc9256e42d4b6a7ccef6883beb6)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.331278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.434746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 903/1781] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:36 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:36.444952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.531753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40c8fc9256e42d4b6a7ccef6883beb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:36.538538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a578f-5333-4bbb-9a6b-6b26ffc8df94 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.543452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40c8fc9256e42d4b6a7ccef6883beb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:36.545051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40c8fc9256e42d4b6a7ccef6883beb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:36.545252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.546183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.546301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.546529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.547492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40c8fc9256e42d4b6a7ccef6883beb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:36.547599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.549635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.565538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6447337f-536a-4b5f-8b8f-4fa3f45f4839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40c8fc9256e42d4b6a7ccef6883beb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:36.641230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 904/1782] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:36 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:36.645019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.648459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:36.664750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 879/1783] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:36 2022] DELETE /identity/v3/users/d40c8fc9256e42d4b6a7ccef6883beb6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:36.670564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d1725-18ea-47d1-8341-59f371a14aee admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.674156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.675158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.675615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.699611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:36.700931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:36.741332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.742021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.742306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.742580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.744142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.745331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.758081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 905/1784] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:36.762289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.774976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 880/1785] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:36.780658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c6f3-6ef0-4142-89b6-021013a073e8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.788604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.798365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.799044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:36.799158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.799362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.799644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.804060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.805782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.823713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 906/1786] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:36.829931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:36.841633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc10e1f-ff83-4d93-b32b-6bd2436b01fb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.850427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.852274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.852849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.853277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] PATH_INFO: `/v3/projects/572638c1488c4b3681c03513e156211b/users/7c54a0f62b774ce4838256a2f97a609e/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.870251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aecdd4-ddbf-4fa0-9ec9-71bd3641d1bd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:36.875823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597582c3-0dc9-4d07-ba7b-38a8415a4794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:36.875972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597582c3-0dc9-4d07-ba7b-38a8415a4794 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.876249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597582c3-0dc9-4d07-ba7b-38a8415a4794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.876823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597582c3-0dc9-4d07-ba7b-38a8415a4794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.877393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572638c1488c4b3681c03513e156211b, user_id=7c54a0f62b774ce4838256a2f97a609e, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.881363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.889916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597582c3-0dc9-4d07-ba7b-38a8415a4794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:36.891841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597582c3-0dc9-4d07-ba7b-38a8415a4794 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:36.904405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 881/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:36.969484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:36.969922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:36.970334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:36.972424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 907/1788] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:36 2022] PUT /identity/v3/projects/572638c1488c4b3681c03513e156211b/users/7c54a0f62b774ce4838256a2f97a609e/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:37.009981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] MFA Rules not processed for user `7c54a0f62b774ce4838256a2f97a609e`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:37.011541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:37.140829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 882/1789] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:37.147683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.255842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4f885-83a4-4b61-aa88-379c5a1c7110 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:37.261589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:37.262583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:37.262878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:37.263160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:37.264035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:37.266170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:37.367431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:37.379751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 908/1790] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:37 2022] POST /identity/v3/projects => generated 401 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:37.386006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.403937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a64e00-4297-47c4-91c0-b19024024103 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:37.434788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.436608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:37.493650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:37.494479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:37.494935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:37.495273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:37.496086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:37.501456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:37.548924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b765-efb8-431b-bc07-dcf6eafce528 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:37.554703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:37.555628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:37.555954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:37.556238 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] PATH_INFO: `/v3/projects/2555382a89af48dc997351e59b8f13d1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:37.557472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2555382a89af48dc997351e59b8f13d1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:37.560759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:37.581471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:37.607220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 883/1791] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:37 2022] POST /identity/v3/users => generated 307 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:37.612773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.626274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ce948-d47e-4e61-83d5-14c6957e0c99 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:37.631115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:37.632425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:37.632748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:37.633038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:37.633760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:37.635404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:37.646321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 884/1792] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:37.650293 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.662340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a837-bee1-485f-b672-ade4cbd1f503 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:37.667205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:37.668636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:37.668927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:37.669207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] PATH_INFO: `/v3/projects/014a5a8bbd2f4b9eb4e4cfe36313a7ea/users/3713284aa7a64571939afb3a129afd6f/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:37.684723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014a5a8bbd2f4b9eb4e4cfe36313a7ea, user_id=3713284aa7a64571939afb3a129afd6f, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:37.687417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:37.809564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 885/1793] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:37 2022] PUT /identity/v3/projects/014a5a8bbd2f4b9eb4e4cfe36313a7ea/users/3713284aa7a64571939afb3a129afd6f/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:37.811218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.813371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:37.833983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2555382a89af48dc997351e59b8f13d1', 'request_id': 'req-c8b1b7a7-4971-476c-9440-ae97a99302f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:37.849996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2555382a89af48dc997351e59b8f13d1', 'request_id': 'req-c8b1b7a7-4971-476c-9440-ae97a99302f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:37.901559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ff57-4dc3-4365-a9d8-209979072100 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:37.922636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2555382a89af48dc997351e59b8f13d1', 'request_id': 'req-c8b1b7a7-4971-476c-9440-ae97a99302f4'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:37.940677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] The token cache is being invalidate because project 2555382a89af48dc997351e59b8f13d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:37.940952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:37.943299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:37.948830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 909/1794] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:37 2022] DELETE /identity/v3/projects/2555382a89af48dc997351e59b8f13d1 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:37.953125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:37.957257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.008974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.009941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.010397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.010681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] PATH_INFO: `/v3/projects/54de77525bc14e13b7e2fd06cf3cd8ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.012138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54de77525bc14e13b7e2fd06cf3cd8ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.015777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.046728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b7a7-4971-476c-9440-ae97a99302f4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:38.053484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.054178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.054466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.054745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.055534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.057197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.068928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 910/1795] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:38.069852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:38.071596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.096196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64c08-540b-4261-b592-c1d4b156c743 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:38.096196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.096196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.096196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.096817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] PATH_INFO: `/v3/users/e413597ea4f84e0bbffb889adf085075` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.097539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e413597ea4f84e0bbffb889adf085075)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.100454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.171159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54de77525bc14e13b7e2fd06cf3cd8ce', 'request_id': 'req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.180328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54de77525bc14e13b7e2fd06cf3cd8ce', 'request_id': 'req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.276799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54de77525bc14e13b7e2fd06cf3cd8ce', 'request_id': 'req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.292135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] The token cache is being invalidate because project 54de77525bc14e13b7e2fd06cf3cd8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:38.292433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.293114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.294710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 886/1796] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:37 2022] DELETE /identity/v3/projects/54de77525bc14e13b7e2fd06cf3cd8ce => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:38.295492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:38.302720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.330316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e413597ea4f84e0bbffb889adf085075'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.341213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e413597ea4f84e0bbffb889adf085075'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.342768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e413597ea4f84e0bbffb889adf085075'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.343497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e413597ea4f84e0bbffb889adf085075'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.358781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb0bb449-485a-4064-bb47-a962c2c55113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e413597ea4f84e0bbffb889adf085075'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:38.388625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8425430-5dd1-4554-b889-7b6ce7f9ebc2 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:38.393345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0759a59-7525-40be-b29f-640067792785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.394249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759a59-7525-40be-b29f-640067792785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.394533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759a59-7525-40be-b29f-640067792785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.394812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759a59-7525-40be-b29f-640067792785 admin admin] PATH_INFO: `/v3/projects/014a5a8bbd2f4b9eb4e4cfe36313a7ea/users/3713284aa7a64571939afb3a129afd6f/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.397424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0759a59-7525-40be-b29f-640067792785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014a5a8bbd2f4b9eb4e4cfe36313a7ea, user_id=3713284aa7a64571939afb3a129afd6f, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.400117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0759a59-7525-40be-b29f-640067792785 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.410808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 887/1797] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:38 2022] PUT /identity/v3/projects/014a5a8bbd2f4b9eb4e4cfe36313a7ea/users/3713284aa7a64571939afb3a129afd6f/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:38.412659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f4ae9-541a-4d2d-b2c4-94ba9ebb1d30 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.412949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f4ae9-541a-4d2d-b2c4-94ba9ebb1d30 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.413228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f4ae9-541a-4d2d-b2c4-94ba9ebb1d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.431446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-de2f4ae9-541a-4d2d-b2c4-94ba9ebb1d30 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:38.432740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-de2f4ae9-541a-4d2d-b2c4-94ba9ebb1d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.438297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 911/1798] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:38 2022] DELETE /identity/v3/users/e413597ea4f84e0bbffb889adf085075 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:38.439731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.440024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.440304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.475308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] MFA Rules not processed for user `3713284aa7a64571939afb3a129afd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:38.476734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.532207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 888/1799] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:38.542165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.542512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.542795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.567609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:38.568886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.572958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 912/1800] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:38.585715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:38.587807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.678521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 889/1801] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:38.682926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:38.695719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e5-20de-4896-bfff-b2ff7b15b3e1 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:38.700943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.702152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.702456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.702789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.704392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:38.704930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.706548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.707787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f36c2-e5f0-46d3-9615-b271c61a1927 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:38.712895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc062a98-d608-42f0-a5bf-ee1660fc6928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.713923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062a98-d608-42f0-a5bf-ee1660fc6928 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.714428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062a98-d608-42f0-a5bf-ee1660fc6928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.714873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062a98-d608-42f0-a5bf-ee1660fc6928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.722809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 890/1802] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:38.726454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc062a98-d608-42f0-a5bf-ee1660fc6928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.728085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:38.728331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc062a98-d608-42f0-a5bf-ee1660fc6928 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.743288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 913/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:38.752697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3139-2c63-4dee-b031-cf5c4ed65cb1 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:38.765044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:38.766249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.766249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.766440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.767426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:38.769094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:38.807176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70dfa-aaa6-4587-8760-d5e7d75d73f1 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.807493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70dfa-aaa6-4587-8760-d5e7d75d73f1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.808002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70dfa-aaa6-4587-8760-d5e7d75d73f1 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.811373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 914/1804] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:11:38.825830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:38.827664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:38.827664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:38.864824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:38.868533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:38.868828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 891/1805] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:38 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:38.872977 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.001291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7273a-4f36-490d-9386-0129508c2e98 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.007110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.007835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.007989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 915/1806] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:39.008455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.008455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.009063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.010100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.011010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.075086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2c45e-96c7-4127-8abb-f96568c85660 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.078930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.079620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.079902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.080174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.081948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.095375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 892/1807] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:38 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:39.095834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.097700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.113966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec8f67-631a-4e5c-b337-b35bd774317a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.120884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.121533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.121734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.122012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.133026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.134747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.146061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 893/1808] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:39.156883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.157062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.158438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.166977 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.168156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 916/1809] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:39.181515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.184607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e077-4f12-42b5-ad83-dfa35ef82a2d service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.190407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.191344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.191672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.191941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] PATH_INFO: `/v3/projects/e1a7f6dd132549299e2a4c99d0882cf4` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.193788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a7f6dd132549299e2a4c99d0882cf4)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.195808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.207395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc297d1-31fe-4b74-8db9-6112fb332f5b service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.216734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.219612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.219612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.219612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.221436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.224857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.239351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 917/1810] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:39.243036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.256658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a7a6-92cc-4e49-b54e-2e17cb25d03c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.269837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.271059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.271357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.271632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.272366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.273976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.296839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 918/1811] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:39.297885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.311014 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481aa0d-0735-4b70-a17f-200d658e619d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.318610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5018d-dee7-4ede-8b7f-c244dcfcccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.320205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5018d-dee7-4ede-8b7f-c244dcfcccda admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.320205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5018d-dee7-4ede-8b7f-c244dcfcccda admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.320442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5018d-dee7-4ede-8b7f-c244dcfcccda admin admin] PATH_INFO: `/v3/projects/930e55cc89c34856a3b7cf7608199ba0/users/a1de667dc92d42e989b5fd98bdedffdf/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.351653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5018d-dee7-4ede-8b7f-c244dcfcccda admin admin] RBAC: Authorizing `identity:create_grant(project_id=930e55cc89c34856a3b7cf7608199ba0, user_id=a1de667dc92d42e989b5fd98bdedffdf, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.354181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5018d-dee7-4ede-8b7f-c244dcfcccda admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.368331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a7f6dd132549299e2a4c99d0882cf4', 'request_id': 'req-d234a7b4-c5a4-465e-98ee-3ad8022dc370'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:39.376546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a7f6dd132549299e2a4c99d0882cf4', 'request_id': 'req-d234a7b4-c5a4-465e-98ee-3ad8022dc370'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:39.453549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 919/1812] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:39 2022] PUT /identity/v3/projects/930e55cc89c34856a3b7cf7608199ba0/users/a1de667dc92d42e989b5fd98bdedffdf/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:39.463891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.464630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.464915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.497666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a7f6dd132549299e2a4c99d0882cf4', 'request_id': 'req-d234a7b4-c5a4-465e-98ee-3ad8022dc370'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:39.516277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] The token cache is being invalidate because project e1a7f6dd132549299e2a4c99d0882cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:39.516888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:39.520227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d234a7b4-c5a4-465e-98ee-3ad8022dc370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:39.522567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] MFA Rules not processed for user `a1de667dc92d42e989b5fd98bdedffdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:39.525154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 894/1813] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:39 2022] DELETE /identity/v3/projects/e1a7f6dd132549299e2a4c99d0882cf4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:39.538398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.540031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7664-867c-461a-8cc7-67346983f1e5 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.540611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7664-867c-461a-8cc7-67346983f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.542032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7664-867c-461a-8cc7-67346983f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.591587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a53c7664-867c-461a-8cc7-67346983f1e5 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:39.592842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a53c7664-867c-461a-8cc7-67346983f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.677926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 920/1814] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:39.682213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.684913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.722776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 895/1815] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:39.731594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79931f99-7891-4e67-942a-77ada4754963 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.731864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79931f99-7891-4e67-942a-77ada4754963 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.735797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79931f99-7891-4e67-942a-77ada4754963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.765410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-79931f99-7891-4e67-942a-77ada4754963 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:39.766637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-79931f99-7891-4e67-942a-77ada4754963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:39.782947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 896/1816] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:39.786892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab93be-cc66-4e79-934a-7503d2bb341f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.787406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79931f99-7891-4e67-942a-77ada4754963 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.794690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.795453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.796147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.796432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.797185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.798361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79931f99-7891-4e67-942a-77ada4754963 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.799149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.804111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.804962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.805300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.805649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.806452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:39.806845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.808627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.823339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 897/1817] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:11:39.827416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.838357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df56b14-8017-46ab-9537-ea12acff8599 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:39.843165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:39.843944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:39.844355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:39.844717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:39.845411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:39.847470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:39.936463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 921/1818] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:39.940592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:39.989693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 898/1819] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:39.994366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.029654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d3643-200b-4767-bdb0-747a254a4328 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.117783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c296b4-0722-43f3-af83-612a36b5d808 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.124813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.125518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.125945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.126228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.126938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.129041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.134552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.135271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.135556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.135846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.136687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.138727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.248124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 899/1820] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:40.259443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.262089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39ab3b-e3ee-48d8-9dff-a796191cea8d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.266949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.267672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.267964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.268243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.268960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.270581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.280208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 900/1821] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:40.283860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.293986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151dec3-a227-4032-ae5e-034741b67d2d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.298626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.299278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.299572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.299850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.300562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.302750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.312925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 901/1822] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:40.317172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.322486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 922/1823] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:39 2022] POST /identity/v3/users => generated 294 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:40.326473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.328034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d78208-1402-46c3-9ebd-69aa4d08802d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.333049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f463-2821-4e68-b1ab-b9771a6c9bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.334221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f463-2821-4e68-b1ab-b9771a6c9bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.334494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f463-2821-4e68-b1ab-b9771a6c9bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.334779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f463-2821-4e68-b1ab-b9771a6c9bbf admin admin] PATH_INFO: `/v3/projects/319e434da56c46e297eddf83eff6a506/users/a52aea32b69c43259da365434b5434ec/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.336594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305ad8-c85b-404a-b298-6f2ee0b007ec admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.341445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.342399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.342680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.343116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.343906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.345496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.350347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f463-2821-4e68-b1ab-b9771a6c9bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=319e434da56c46e297eddf83eff6a506, user_id=a52aea32b69c43259da365434b5434ec, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.353134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f463-2821-4e68-b1ab-b9771a6c9bbf admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.356122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 923/1824] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:40.360013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.370392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd6f6e-eb06-4191-a819-82977cc25a5d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.375160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.375877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.376163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.376490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.377311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.378914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.390246 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 924/1825] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:40.394513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.404477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6348-a176-4e70-a353-585168370b21 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.409093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b92fd-be62-4c44-87a2-0517881874cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.410019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b92fd-be62-4c44-87a2-0517881874cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.410300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b92fd-be62-4c44-87a2-0517881874cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.410578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b92fd-be62-4c44-87a2-0517881874cf admin admin] PATH_INFO: `/v3/projects/e76ca4c70d004bacb1426481e3ec596f/users/511f3720d20140eeb4b89127e15a8cf4/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.427699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b92fd-be62-4c44-87a2-0517881874cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76ca4c70d004bacb1426481e3ec596f, user_id=511f3720d20140eeb4b89127e15a8cf4, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.430349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b92fd-be62-4c44-87a2-0517881874cf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.446851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 902/1826] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:40 2022] PUT /identity/v3/projects/319e434da56c46e297eddf83eff6a506/users/a52aea32b69c43259da365434b5434ec/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:40.459782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.460160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.460450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.488055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] MFA Rules not processed for user `a52aea32b69c43259da365434b5434ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:40.490001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:40.520647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 925/1827] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:40 2022] PUT /identity/v3/projects/e76ca4c70d004bacb1426481e3ec596f/users/511f3720d20140eeb4b89127e15a8cf4/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:40.522177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37029-a916-45fb-b07e-bef62428705b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.522470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37029-a916-45fb-b07e-bef62428705b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.522751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37029-a916-45fb-b07e-bef62428705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.551105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-23e37029-a916-45fb-b07e-bef62428705b None None] MFA Rules not processed for user `511f3720d20140eeb4b89127e15a8cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:40.552966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-23e37029-a916-45fb-b07e-bef62428705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:40.560170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 903/1828] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:40.564662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.637773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 926/1829] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:40.642169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e37029-a916-45fb-b07e-bef62428705b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.650445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6505a3e-134b-4b20-8239-8219d9e02d80 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.713899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e37029-a916-45fb-b07e-bef62428705b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.716528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.717228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.717516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.717859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.718572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.719401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.720157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.720782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.725090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.725219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.725219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.725219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.728062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:40.774277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:40.808410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 927/1831] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:40 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:40.811458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 904/1831] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:40 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:40.812553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.814966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.879416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9dbb6-ed04-43be-9cd7-583b6e220fad admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.884484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.885166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.885511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.885690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240754c-44d3-4760-be3a-2128d93e9f7b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.885801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.886482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.888711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.891270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.891966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.892271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.892550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.893247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:40.895179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:40.978387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 905/1832] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:40 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:40.982251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:40.992029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f833-9ff5-470a-b816-46c75bb1bc82 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:40.996687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:40.997344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:40.997639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:40.997907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:40.998630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.000652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.011979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 906/1833] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:41.014366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 928/1834] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:40 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:41.018467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.027022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.029988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836f799-40f4-4c1e-96c2-1ad41981924d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.034769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.035472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.035760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.036168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.037055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.037440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc3ec-81ce-406e-9141-f55fe10b7fe3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.039195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.043054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.044074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.044394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.045096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] PATH_INFO: `/v3/projects/aaadb09e12974d35a90cec0aa5ab1830/users/90a7a9ce49784cf08b2d0a53767af6e1/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.053655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 907/1835] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:41.054684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.062990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaadb09e12974d35a90cec0aa5ab1830, user_id=90a7a9ce49784cf08b2d0a53767af6e1, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.064691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9c6a-43cc-49e0-8214-560150583fb4 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.065690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.070181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.071108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.071533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.071813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] PATH_INFO: `/v3/projects/20d7624935b94cd19a8c8fbeff75e308/users/817f12fbf8c24e9db9bd3048a24d0eea/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.087055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d7624935b94cd19a8c8fbeff75e308, user_id=817f12fbf8c24e9db9bd3048a24d0eea, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.090261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.162593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 929/1836] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:41 2022] PUT /identity/v3/projects/aaadb09e12974d35a90cec0aa5ab1830/users/90a7a9ce49784cf08b2d0a53767af6e1/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:41.166497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.185999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 908/1837] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:41 2022] PUT /identity/v3/projects/20d7624935b94cd19a8c8fbeff75e308/users/817f12fbf8c24e9db9bd3048a24d0eea/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:41.190207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.229860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044434c-3ab8-4544-8838-867e1ec62d21 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.257187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b7f40-bc26-4b16-a4f4-b549d02e7fe8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.262865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.266812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.267107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.267508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.268257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.270100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.284389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 909/1838] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:41.288253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.293486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.294168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.294456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.294733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.295498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.297196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.299762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba23c5-b96e-483b-8340-d454992db844 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.305221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1bae6-0607-4dc7-b3b0-53e34ead03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.306171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bae6-0607-4dc7-b3b0-53e34ead03f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.306708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bae6-0607-4dc7-b3b0-53e34ead03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.308485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1bae6-0607-4dc7-b3b0-53e34ead03f0 admin admin] PATH_INFO: `/v3/projects/20d7624935b94cd19a8c8fbeff75e308/users/817f12fbf8c24e9db9bd3048a24d0eea/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.309137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bae6-0607-4dc7-b3b0-53e34ead03f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d7624935b94cd19a8c8fbeff75e308, user_id=817f12fbf8c24e9db9bd3048a24d0eea, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.311809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1bae6-0607-4dc7-b3b0-53e34ead03f0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.319090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 930/1839] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:41.322900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.328210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 910/1840] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:41 2022] PUT /identity/v3/projects/20d7624935b94cd19a8c8fbeff75e308/users/817f12fbf8c24e9db9bd3048a24d0eea/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:41.333842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155385-70e8-410e-af67-4cddb93cde47 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.340324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.340612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.340890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.371150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] MFA Rules not processed for user `817f12fbf8c24e9db9bd3048a24d0eea`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:41.372544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:41.400191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52f01-6bf7-4606-bfb9-c866737b73a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.401406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52f01-6bf7-4606-bfb9-c866737b73a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.403672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52f01-6bf7-4606-bfb9-c866737b73a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.404046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52f01-6bf7-4606-bfb9-c866737b73a7 admin admin] PATH_INFO: `/v3/projects/aaadb09e12974d35a90cec0aa5ab1830/users/90a7a9ce49784cf08b2d0a53767af6e1/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.407112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee52f01-6bf7-4606-bfb9-c866737b73a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaadb09e12974d35a90cec0aa5ab1830, user_id=90a7a9ce49784cf08b2d0a53767af6e1, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.410217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee52f01-6bf7-4606-bfb9-c866737b73a7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.423427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 931/1841] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:41 2022] PUT /identity/v3/projects/aaadb09e12974d35a90cec0aa5ab1830/users/90a7a9ce49784cf08b2d0a53767af6e1/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:41.435564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.435564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.435846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.465337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] MFA Rules not processed for user `90a7a9ce49784cf08b2d0a53767af6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:41.467468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 911/1842] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:41.467582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:41.481282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.486119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:41.550447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 932/1843] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:41.572519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa7cde-ca5f-4f61-aa7e-b24e65141db7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.648213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.648898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.649189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.649464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.674726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:41.676231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:41.699303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b2e42-c55e-454c-bd28-bd04eb7515df None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:41.704681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:41.705534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:41.706342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:41.706772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:41.725060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.726690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.733594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:41.735048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:41.747499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 933/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:41.753696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 912/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:42.151050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:42.493610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:42.754413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:42.765676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85debed9-5242-43dc-8abd-4ba4ddc97723 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:42.770242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '817f12fbf8c24e9db9bd3048a24d0eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20d7624935b94cd19a8c8fbeff75e308', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:42.770923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:42.771193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:42.771553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:42.772846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:42.773170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:42.774763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:42.786458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 934/1846] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:42.790951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:42.800085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb025973-4029-4359-8b03-31c04f9c1383 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:42.805387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '817f12fbf8c24e9db9bd3048a24d0eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20d7624935b94cd19a8c8fbeff75e308', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:42.806218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:42.806905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:42.809775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:42.809775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:42.809967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:42.907097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 913/1847] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:42 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:42.912665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:42.933276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445701b-a890-481e-b462-29f9ad1655fa tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:42.991632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '817f12fbf8c24e9db9bd3048a24d0eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20d7624935b94cd19a8c8fbeff75e308', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:42.992500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:42.992785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:42.993068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:42.993802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:42.994112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:42.995949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:43.013549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 935/1848] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:43.035338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:43.051750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:43.062895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecebf35-d6e4-41c9-8878-2657093dfe05 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:43.067705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '817f12fbf8c24e9db9bd3048a24d0eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20d7624935b94cd19a8c8fbeff75e308', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:43.069193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:43.069502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:43.069798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] PATH_INFO: `/v3/projects/9a073918dbb44d76ae3ac82599b30508` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:43.071057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a073918dbb44d76ae3ac82599b30508)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:43.073121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:43.088719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:43.209138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a073918dbb44d76ae3ac82599b30508', 'request_id': 'req-19af5b97-ad89-4383-b51d-486ace27c300'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:43.220869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a073918dbb44d76ae3ac82599b30508', 'request_id': 'req-19af5b97-ad89-4383-b51d-486ace27c300'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:43.297843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a073918dbb44d76ae3ac82599b30508', 'request_id': 'req-19af5b97-ad89-4383-b51d-486ace27c300'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:43.309753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] The token cache is being invalidate because project 9a073918dbb44d76ae3ac82599b30508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:43.310123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:43.310875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-19af5b97-ad89-4383-b51d-486ace27c300 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:43.312528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 914/1849] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:43 2022] DELETE /identity/v3/projects/9a073918dbb44d76ae3ac82599b30508 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:43.585621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:43.682753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:43.996054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:44.255312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:44.255619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:44.258008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:44.334153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c773b4-c76d-45ec-9dcf-8864ff541780 tempest-VolumeQuotaClassesTest-1387135881 tempest-VolumeQuotaClassesTest-1387135881-project-admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:44.392170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:44.392927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:44.393209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:44.393481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] PATH_INFO: `/v3/users/a52aea32b69c43259da365434b5434ec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:44.394672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52aea32b69c43259da365434b5434ec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:44.396697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:44.590949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52aea32b69c43259da365434b5434ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:44.597654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52aea32b69c43259da365434b5434ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:44.598317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52aea32b69c43259da365434b5434ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:44.598928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52aea32b69c43259da365434b5434ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:44.611615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52aea32b69c43259da365434b5434ec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:44.714714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 936/1850] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:44 2022] DELETE /identity/v3/users/a52aea32b69c43259da365434b5434ec => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:44.719344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:44.719748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:44.719910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:44.737707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:44.738929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:44.791372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:44.800604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 915/1851] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:44.806380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:44.807806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:44.811181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:44.812674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:44.821211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698e46-1eb5-4d62-88e5-5d549a7bdf6e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:44.826166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:44.827073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:44.827400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:44.827679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] PATH_INFO: `/v3/users/7c54a0f62b774ce4838256a2f97a609e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:44.828883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c54a0f62b774ce4838256a2f97a609e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:44.830806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:44.868909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518f6f-f121-453a-a8be-f30022e4d619 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:44.872423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffd551-8e43-4c51-8cff-e5a0df3cf9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:44.873074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd551-8e43-4c51-8cff-e5a0df3cf9bb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:44.873354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd551-8e43-4c51-8cff-e5a0df3cf9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:44.873628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffd551-8e43-4c51-8cff-e5a0df3cf9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:44.882896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd551-8e43-4c51-8cff-e5a0df3cf9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:44.884425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffd551-8e43-4c51-8cff-e5a0df3cf9bb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:44.894516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 916/1852] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:44.993541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c54a0f62b774ce4838256a2f97a609e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.000589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c54a0f62b774ce4838256a2f97a609e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.001545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c54a0f62b774ce4838256a2f97a609e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.002137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c54a0f62b774ce4838256a2f97a609e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.015464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c54a0f62b774ce4838256a2f97a609e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.131033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 937/1853] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:44 2022] DELETE /identity/v3/users/7c54a0f62b774ce4838256a2f97a609e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:45.135701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:45.136196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:45.136671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:45.173725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:45.174999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:45.227580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:45.228996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:45.250061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 917/1854] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:45.262251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:45.263960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:45.295330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfe7d3-61f1-4a3d-8711-0ed7bdbec5b3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:45.300389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:45.301081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:45.301373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:45.301652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:45.304762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:45.324062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982c1b7-fabb-4585-8508-1999d1045182 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:45.328115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:45.328780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:45.329068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:45.329345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:45.340107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:45.341555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:45.353441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 918/1855] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:45.373725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:45.376160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:45.385652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:45.403586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 938/1856] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:45.453989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:45.495840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:45.498352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:45.518978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a328-7e0d-47f7-b014-32f1092589b3 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:45.532847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:45.534122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:45.534757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:45.535298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] PATH_INFO: `/v3/projects/319e434da56c46e297eddf83eff6a506` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:45.537098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319e434da56c46e297eddf83eff6a506)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:45.539791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:45.707335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319e434da56c46e297eddf83eff6a506', 'request_id': 'req-4017a1be-3b8e-43de-a290-e352875d9f56'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.717772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319e434da56c46e297eddf83eff6a506', 'request_id': 'req-4017a1be-3b8e-43de-a290-e352875d9f56'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.820928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:45.821597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319e434da56c46e297eddf83eff6a506', 'request_id': 'req-4017a1be-3b8e-43de-a290-e352875d9f56'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.832567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] The token cache is being invalidate because project 319e434da56c46e297eddf83eff6a506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:45.832856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.833491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:45.835124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 919/1857] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:45 2022] DELETE /identity/v3/projects/319e434da56c46e297eddf83eff6a506 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:45.839181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:45.849846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f07465-c8a4-4a01-a61d-04dbed82488d service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:45.878899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:45.885816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:45.887677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:45.923694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:45.924748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:45.925117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:45.925502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] PATH_INFO: `/v3/users/817f12fbf8c24e9db9bd3048a24d0eea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:45.926818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817f12fbf8c24e9db9bd3048a24d0eea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:45.931401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:45.962866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a1be-3b8e-43de-a290-e352875d9f56 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:45.967725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:45.968596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:45.968876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:45.969150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] PATH_INFO: `/v3/projects/572638c1488c4b3681c03513e156211b` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:45.970371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572638c1488c4b3681c03513e156211b)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:45.972406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:46.118510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:46.134162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817f12fbf8c24e9db9bd3048a24d0eea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.143457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572638c1488c4b3681c03513e156211b', 'request_id': 'req-b3e8920c-71f0-4aaf-afbc-2099264c8d76'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.144124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817f12fbf8c24e9db9bd3048a24d0eea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.144202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572638c1488c4b3681c03513e156211b', 'request_id': 'req-b3e8920c-71f0-4aaf-afbc-2099264c8d76'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.146353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817f12fbf8c24e9db9bd3048a24d0eea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.147131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817f12fbf8c24e9db9bd3048a24d0eea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.159877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817f12fbf8c24e9db9bd3048a24d0eea'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.191155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:46.225748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572638c1488c4b3681c03513e156211b', 'request_id': 'req-b3e8920c-71f0-4aaf-afbc-2099264c8d76'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.236836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] The token cache is being invalidate because project 572638c1488c4b3681c03513e156211b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:46.237197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.237853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.239438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 920/1858] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:45 2022] DELETE /identity/v3/projects/572638c1488c4b3681c03513e156211b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:46.243909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:46.245203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:46.307883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8920c-71f0-4aaf-afbc-2099264c8d76 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:46.310447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 939/1859] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:45 2022] DELETE /identity/v3/users/817f12fbf8c24e9db9bd3048a24d0eea => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:46.312885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:46.314201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:46.314201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:46.314347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] PATH_INFO: `/v3/users/3713284aa7a64571939afb3a129afd6f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:46.315688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3713284aa7a64571939afb3a129afd6f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:46.317688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:46.390658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:46.477048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:46.518738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3713284aa7a64571939afb3a129afd6f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.526480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3713284aa7a64571939afb3a129afd6f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.528566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3713284aa7a64571939afb3a129afd6f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.529974 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3713284aa7a64571939afb3a129afd6f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.543559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3713284aa7a64571939afb3a129afd6f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:46.636747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 921/1860] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:46 2022] DELETE /identity/v3/users/3713284aa7a64571939afb3a129afd6f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:47.092103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.096672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:47.112197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:47.208867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0015ed9-6ff3-4b34-a384-1e81963f8204 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.265015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:47.268227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:47.269163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.269452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.269732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] PATH_INFO: `/v3/projects/20d7624935b94cd19a8c8fbeff75e308` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.270956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d7624935b94cd19a8c8fbeff75e308)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:47.272989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:47.316772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.318201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:47.332382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346c70a-40d4-4dcb-9262-bf4db879b9b2 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.337770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:47.338648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.339163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.339528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] PATH_INFO: `/v3/projects/014a5a8bbd2f4b9eb4e4cfe36313a7ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.340799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014a5a8bbd2f4b9eb4e4cfe36313a7ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:47.342649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:47.420779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d7624935b94cd19a8c8fbeff75e308', 'request_id': 'req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.427621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d7624935b94cd19a8c8fbeff75e308', 'request_id': 'req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.469592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014a5a8bbd2f4b9eb4e4cfe36313a7ea', 'request_id': 'req-78e73257-3887-41cd-b0ba-a0683627e315'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.476315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014a5a8bbd2f4b9eb4e4cfe36313a7ea', 'request_id': 'req-78e73257-3887-41cd-b0ba-a0683627e315'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.539593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d7624935b94cd19a8c8fbeff75e308', 'request_id': 'req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.550714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] The token cache is being invalidate because project 20d7624935b94cd19a8c8fbeff75e308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:47.551001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.551644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b7b88bd7-cbaa-4aaa-9f59-f15f6a439a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.553237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 940/1861] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:47 2022] DELETE /identity/v3/projects/20d7624935b94cd19a8c8fbeff75e308 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:47.559494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806110e-64dd-4ed2-90e1-2e3937a17731 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.559788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806110e-64dd-4ed2-90e1-2e3937a17731 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.560068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806110e-64dd-4ed2-90e1-2e3937a17731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.580508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f806110e-64dd-4ed2-90e1-2e3937a17731 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:47.581780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f806110e-64dd-4ed2-90e1-2e3937a17731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:47.607636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014a5a8bbd2f4b9eb4e4cfe36313a7ea', 'request_id': 'req-78e73257-3887-41cd-b0ba-a0683627e315'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.619155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] The token cache is being invalidate because project 014a5a8bbd2f4b9eb4e4cfe36313a7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:47.619473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.620120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-78e73257-3887-41cd-b0ba-a0683627e315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:47.625179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 922/1862] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:47 2022] DELETE /identity/v3/projects/014a5a8bbd2f4b9eb4e4cfe36313a7ea => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:47.626471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76bbf-9d36-4da6-a779-134a86af5a59 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.626838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76bbf-9d36-4da6-a779-134a86af5a59 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.627134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76bbf-9d36-4da6-a779-134a86af5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.645164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 941/1863] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:47.646336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9dc76bbf-9d36-4da6-a779-134a86af5a59 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:47.648109 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9dc76bbf-9d36-4da6-a779-134a86af5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:47.653418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.653713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.653995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.656416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 923/1864] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:47.665639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.665933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.666213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.677901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:47.679111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:47.683710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:47.684929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:47.687008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 942/1865] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:47.691294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.694106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 924/1866] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:47.701236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad946-64e3-4b11-9c17-306082e68585 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.704552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.706022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:47.706677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.706967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.707277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.708083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:47.708397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:47.710586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:47.714246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aec694-9e5d-477d-8e9f-b32b01dc49e4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.719544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:47.720403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.720729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.720994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.721712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:47.722016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:47.725721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 943/1867] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:11:47.725844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:47.726666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.735505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 925/1868] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:11:47.736277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984dfa9-bb0f-4eb4-bfac-96ff2a535a13 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.739757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.741339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:47.742019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.742312 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.742663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.743396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:47.745321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:47.749629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941504e-90b2-4155-8a8a-b49a2e60a36a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.754383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:47.755031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:47.755354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:47.755634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:47.756842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:47.758728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:47.853436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 944/1869] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:47.857539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.897847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 926/1870] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/projects => generated 407 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:47.901614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:47.934186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d461-6e28-4a7c-b470-c3faa6d21908 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:47.935709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:48.005761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.006937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3dc9-733b-4ff6-8ea9-cd6d97a1b853 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.014726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.014726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.014726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.014726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.014726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.019342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.021076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.023706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.024271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.033750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.033750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.121703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 945/1871] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:48.124270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 927/1872] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:47 2022] POST /identity/v3/users => generated 304 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:48.129797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.136949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.148786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03038ce-1c81-4b7a-8f76-1fb83d731bdb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.152763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3ae8b-b478-4e68-981c-c1c781159903 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.155675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.156591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.156894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.157178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.157919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.158640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.159349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.159600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.159697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.159932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.160673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.162475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.171494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 946/1873] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:48.175470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.179582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 928/1874] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:48.189723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1546d4-df5f-4121-9ae5-ecbb51b3e6d9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.190607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.197766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.198518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.198819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.199102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.200113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.201932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.215316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c6b0-1832-4f8f-807f-d615192a56cb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.224435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 947/1875] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:48.224435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.229939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.230634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.230925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.231207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.232054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.238754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.249797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1aa41-03f2-490b-b12e-7fddcffc08b5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.264031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490776a3-1a23-45b5-af15-e72d88d53fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.266289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490776a3-1a23-45b5-af15-e72d88d53fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.267212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490776a3-1a23-45b5-af15-e72d88d53fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.267212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490776a3-1a23-45b5-af15-e72d88d53fb1 admin admin] PATH_INFO: `/v3/projects/c4e09aa2e397446f9efa4d1494c2da0b/users/c23a345e27854e6bb21a0d00935012a9/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.274202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 929/1876] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:48.277792 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.301777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83516224-1f74-452d-b254-abdcf33004e8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.306196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490776a3-1a23-45b5-af15-e72d88d53fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e09aa2e397446f9efa4d1494c2da0b, user_id=c23a345e27854e6bb21a0d00935012a9, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.312995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b6ff3-7a7b-427d-b17f-bd537b472746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.313917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6ff3-7a7b-427d-b17f-bd537b472746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.314028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490776a3-1a23-45b5-af15-e72d88d53fb1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.314212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6ff3-7a7b-427d-b17f-bd537b472746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.314480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6ff3-7a7b-427d-b17f-bd537b472746 admin admin] PATH_INFO: `/v3/projects/97a6eb32f9d34784a9a03bb5afdaa3b8/users/75ad9737c3a84843a5140c016f0eb570/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.333210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b6ff3-7a7b-427d-b17f-bd537b472746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a6eb32f9d34784a9a03bb5afdaa3b8, user_id=75ad9737c3a84843a5140c016f0eb570, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.336082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b6ff3-7a7b-427d-b17f-bd537b472746 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.343887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:48.414678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 948/1877] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:48 2022] PUT /identity/v3/projects/c4e09aa2e397446f9efa4d1494c2da0b/users/c23a345e27854e6bb21a0d00935012a9/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:48.423409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 930/1878] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:48 2022] PUT /identity/v3/projects/97a6eb32f9d34784a9a03bb5afdaa3b8/users/75ad9737c3a84843a5140c016f0eb570/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:48.425360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.425736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.426077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.430229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.430531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.430813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.458857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] MFA Rules not processed for user `75ad9737c3a84843a5140c016f0eb570`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:48.461045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:48.465363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] MFA Rules not processed for user `c23a345e27854e6bb21a0d00935012a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:48.467027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:48.547299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 931/1879] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:48.559484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.560856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:48.562670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 949/1880] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:48.566948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.622617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe6fa9-85aa-4736-b819-9114459d3003 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.626509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.627569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.627928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.628304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.636927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175c091-2cf6-4cfb-acd5-440d0e5f393c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.639198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.640917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.641903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.642566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.642849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.643124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.643851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.645762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.659322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 932/1881] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:48.675078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.687527 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d546-44f0-4097-ae3a-02223d1e6dbc service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.692316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.693199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.694124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.694411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] PATH_INFO: `/v3/users/75ad9737c3a84843a5140c016f0eb570` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.695687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ad9737c3a84843a5140c016f0eb570)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.697611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.728332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:48.738469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 950/1882] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:48 2022] POST /identity/v3/projects => generated 407 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:48.741154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.802307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fc90d-2d3b-4b12-864e-334c246b57ed admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.809122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.809804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.810095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.810374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.811068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.813094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.879097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ad9737c3a84843a5140c016f0eb570'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:48.886996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ad9737c3a84843a5140c016f0eb570'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:48.887999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ad9737c3a84843a5140c016f0eb570'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:48.888694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ad9737c3a84843a5140c016f0eb570'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:48.902347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8f455ad9-f705-43ad-a7ed-b101efbcf4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ad9737c3a84843a5140c016f0eb570'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:48.933579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 951/1883] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:48 2022] POST /identity/v3/users => generated 310 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:48.937658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.939280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:48.955182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fe2f8-2ad9-4cfd-8b2b-cdd7e032992e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.959998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.960782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.961075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.961380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:48.962164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:48.963853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:48.975275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 952/1884] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:48.979493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:48.990041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9e4c3-3f2e-4d48-8721-dfbd18855485 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:48.995329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:48.996222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:48.996504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:48.996780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] PATH_INFO: `/v3/projects/09f7cd1a3057497797d51b23912a7aa3/users/8ff8e3110861441ba275c73fbd785b54/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.015158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f7cd1a3057497797d51b23912a7aa3, user_id=8ff8e3110861441ba275c73fbd785b54, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:49.017902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:49.037668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 933/1885] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:48 2022] DELETE /identity/v3/users/75ad9737c3a84843a5140c016f0eb570 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:49.042341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:49.042682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:49.042967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.061032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:49.062801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:49.093832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 953/1886] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:48 2022] PUT /identity/v3/projects/09f7cd1a3057497797d51b23912a7aa3/users/8ff8e3110861441ba275c73fbd785b54/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:49.097994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:49.127666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 934/1887] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:49.138103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:49.139505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:49.153702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:49.167605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ec3f4-2323-4ee5-9b8e-9a3b8421a78a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:49.174712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:49.175044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:49.175349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:49.175631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.176933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:49.180309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:49.192427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 954/1888] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:49.197043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:49.204778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aeb70-8d5e-45dc-9933-0db6f2b11b4f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:49.208311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc053753-05bf-4354-a350-34295fe2fff9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:49.213026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675fcf-17c1-4fd0-92cc-fc8ac0596922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:49.214029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675fcf-17c1-4fd0-92cc-fc8ac0596922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:49.214317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675fcf-17c1-4fd0-92cc-fc8ac0596922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:49.218113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675fcf-17c1-4fd0-92cc-fc8ac0596922 admin admin] PATH_INFO: `/v3/projects/09f7cd1a3057497797d51b23912a7aa3/users/8ff8e3110861441ba275c73fbd785b54/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.218113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675fcf-17c1-4fd0-92cc-fc8ac0596922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f7cd1a3057497797d51b23912a7aa3, user_id=8ff8e3110861441ba275c73fbd785b54, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:49.220143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675fcf-17c1-4fd0-92cc-fc8ac0596922 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:49.232290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 955/1889] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:49 2022] PUT /identity/v3/projects/09f7cd1a3057497797d51b23912a7aa3/users/8ff8e3110861441ba275c73fbd785b54/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:11:49.244670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:49.246842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:49.246842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.283624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] MFA Rules not processed for user `8ff8e3110861441ba275c73fbd785b54`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:49.284879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:49.288573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:49.289241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:49.289523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:49.292065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.305316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:49.307487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:49.322500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 935/1890] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:49.372106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 956/1891] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:11:49.383825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:49.385382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:49.450886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447486e-88ff-47cd-8081-8b699dbffafb service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:49.505899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:49.509712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4012b7-f8c4-4c33-aa06-21193da05773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:49.510529 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4012b7-f8c4-4c33-aa06-21193da05773 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:49.510818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4012b7-f8c4-4c33-aa06-21193da05773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:49.511097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4012b7-f8c4-4c33-aa06-21193da05773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:49.520569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4012b7-f8c4-4c33-aa06-21193da05773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:49.522046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4012b7-f8c4-4c33-aa06-21193da05773 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:49.531829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 936/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:49.564248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:49.923689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:49.934125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:50.033649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8811c4-20e0-4983-ad7c-1e94c2a9685c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.038460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.039364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.039648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.039920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] PATH_INFO: `/v3/projects/97a6eb32f9d34784a9a03bb5afdaa3b8` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.041092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a6eb32f9d34784a9a03bb5afdaa3b8)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.043091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.154941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:50.172041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a6eb32f9d34784a9a03bb5afdaa3b8', 'request_id': 'req-7fd6a39c-b0ae-4302-889f-f9e2520da782'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:50.178182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a6eb32f9d34784a9a03bb5afdaa3b8', 'request_id': 'req-7fd6a39c-b0ae-4302-889f-f9e2520da782'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:50.247347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a6eb32f9d34784a9a03bb5afdaa3b8', 'request_id': 'req-7fd6a39c-b0ae-4302-889f-f9e2520da782'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:50.259080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] The token cache is being invalidate because project 97a6eb32f9d34784a9a03bb5afdaa3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:11:50.259531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:50.260175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7fd6a39c-b0ae-4302-889f-f9e2520da782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:50.261746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 957/1893] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:11:49 2022] DELETE /identity/v3/projects/97a6eb32f9d34784a9a03bb5afdaa3b8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:50.266843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.267128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.268495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.287065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:50.288304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:50.348018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 937/1894] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:50.350664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:50.356927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.357220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.357505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.376144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:50.377342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:50.385994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 958/1895] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:50.391702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.401358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d750de3-dad2-49f1-9d97-5170712bbd7c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.406158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.407000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.407323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.407612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.408340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:11:50.408654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.410445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.422570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 938/1896] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:11:50.426878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.436938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659b52f-c68b-4274-82eb-dae468b25e44 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.441760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.442430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.442715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.442996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.444326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.446277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.541671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.543741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:50.570388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 959/1897] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:11:50 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:11:50.574431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.623988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d0c1-a657-4aee-8f56-3b1722bb53ee admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.656308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcdae5-b444-4ae0-93a3-2446c121700b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.662705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.663624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.663979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.664335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.665141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.667397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.697596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.702120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.702120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.702120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.702120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:50.769563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.771022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.780636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 939/1898] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:50.793694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 960/1899] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:11:50 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:11:50.794722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.807692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16a5d-027a-422a-b010-e055e3013cbb service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.813018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.813712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.813996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.814271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.815008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.816765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.837765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 940/1900] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:11:50.839044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.855260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f140d-5c19-4309-b5d2-dc77f8e621b2 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.861743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c985-aca4-4939-a279-24728b1aff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.861743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c985-aca4-4939-a279-24728b1aff8d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.861893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c985-aca4-4939-a279-24728b1aff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.862087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c985-aca4-4939-a279-24728b1aff8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.862971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c985-aca4-4939-a279-24728b1aff8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.865888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c985-aca4-4939-a279-24728b1aff8d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:50.898215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 961/1901] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:11:50.899406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:50.914825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b954ea-5a37-4573-8bf8-3d69c210998a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:50.925265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:50.928519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:50.928823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:50.929114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] PATH_INFO: `/v3/projects/007759614d4f4aa3b7f1932d5f55b78a/users/5cdf3cd10df148439670673d38f764ce/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:50.956983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007759614d4f4aa3b7f1932d5f55b78a, user_id=5cdf3cd10df148439670673d38f764ce, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:50.962122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:51.082954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 941/1902] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:11:50 2022] PUT /identity/v3/projects/007759614d4f4aa3b7f1932d5f55b78a/users/5cdf3cd10df148439670673d38f764ce/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:51.093783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:51.094265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:51.094639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:51.121839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] MFA Rules not processed for user `5cdf3cd10df148439670673d38f764ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:51.123058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:51.187175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 962/1903] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:11:51.199745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:51.201640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:51.259011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a53c1-4262-453b-942b-f7e3e7cc5170 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:51.262985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:51.263667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:51.263955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:51.264235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:51.272684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:51.274058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:51.282920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 942/1904] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:11:51.309386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:51.493541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:51.872793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:52.195012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:52.196639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:52.258884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5453a-7a6c-4fb3-872a-3bb61216ef20 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:52.269043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:52.269043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:52.269043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:52.269043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:52.269421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:52.377732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:52.379489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c45e-4ac2-409d-a342-aff0fc981df8 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:52.394997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 963/1905] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:11:59.577188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:11:59.578627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:11:59.647000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a939a3e-610c-4ed4-8daf-d74f490da88c service glance] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:11:59.651631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:11:59.652547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:59.652836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:59.653112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] PATH_INFO: `/v3/users/a1de667dc92d42e989b5fd98bdedffdf` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:59.654311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1de667dc92d42e989b5fd98bdedffdf)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:11:59.656325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:11:59.843956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1de667dc92d42e989b5fd98bdedffdf'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:59.851380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1de667dc92d42e989b5fd98bdedffdf'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:59.852089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1de667dc92d42e989b5fd98bdedffdf'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:59.852711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1de667dc92d42e989b5fd98bdedffdf'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:59.869397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1de667dc92d42e989b5fd98bdedffdf'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:11:59.970150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 943/1906] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:11:59 2022] DELETE /identity/v3/users/a1de667dc92d42e989b5fd98bdedffdf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:11:59.972316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:11:59.972812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:11:59.973098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:11:59.992106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:11:59.993317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:00.055750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 964/1907] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:00.065717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:00.067318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:00.123455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:00.127220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14280c-0ddd-4db4-a28e-b9ba75f8139d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:00.131007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:00.131737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:00.132286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:00.132591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:00.141943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:00.143787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:00.155552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 944/1908] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:00.565755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:00.567707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:00.586183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef842d5-ff73-48dc-9a66-85ae82407f24 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:00.604432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:00.605253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:00.606266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:00.606266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] PATH_INFO: `/v3/projects/930e55cc89c34856a3b7cf7608199ba0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:00.607054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930e55cc89c34856a3b7cf7608199ba0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:00.609017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:00.653188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:00.758811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930e55cc89c34856a3b7cf7608199ba0', 'request_id': 'req-ead0da32-79ad-48c7-ae98-f1eb2794a891'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:00.765276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930e55cc89c34856a3b7cf7608199ba0', 'request_id': 'req-ead0da32-79ad-48c7-ae98-f1eb2794a891'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:00.851853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930e55cc89c34856a3b7cf7608199ba0', 'request_id': 'req-ead0da32-79ad-48c7-ae98-f1eb2794a891'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:00.862808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] The token cache is being invalidate because project 930e55cc89c34856a3b7cf7608199ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:00.863094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:00.863772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:00.865315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 965/1909] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:00 2022] DELETE /identity/v3/projects/930e55cc89c34856a3b7cf7608199ba0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:00.869363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:00.879481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d312-ee34-4336-a0a5-963058b086ba service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:00.940092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:00.940993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:00.941357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:00.941576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] PATH_INFO: `/v3/users/511f3720d20140eeb4b89127e15a8cf4` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:00.942809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511f3720d20140eeb4b89127e15a8cf4)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:00.945167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:01.167880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511f3720d20140eeb4b89127e15a8cf4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:01.174738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511f3720d20140eeb4b89127e15a8cf4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:01.175440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511f3720d20140eeb4b89127e15a8cf4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:01.176047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511f3720d20140eeb4b89127e15a8cf4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:01.188505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511f3720d20140eeb4b89127e15a8cf4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:01.503567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 945/1910] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:00 2022] DELETE /identity/v3/users/511f3720d20140eeb4b89127e15a8cf4 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:02.371796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:02.373456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:02.388011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0da32-79ad-48c7-ae98-f1eb2794a891 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:02.453543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:02.454418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:02.454701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:02.459591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] PATH_INFO: `/v3/projects/e76ca4c70d004bacb1426481e3ec596f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:02.459591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76ca4c70d004bacb1426481e3ec596f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:02.459591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:02.461272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:02.463368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:02.476755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85ff2b-87ec-46e4-bd08-9a8d3af1bfa7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:02.482607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:02.483613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:02.483967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:02.484319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] PATH_INFO: `/v3/users/c23a345e27854e6bb21a0d00935012a9` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:02.486010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23a345e27854e6bb21a0d00935012a9)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:02.488471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:02.567459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76ca4c70d004bacb1426481e3ec596f', 'request_id': 'req-3b2c9621-9176-439d-8350-6d93a252e291'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.574412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76ca4c70d004bacb1426481e3ec596f', 'request_id': 'req-3b2c9621-9176-439d-8350-6d93a252e291'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.670971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76ca4c70d004bacb1426481e3ec596f', 'request_id': 'req-3b2c9621-9176-439d-8350-6d93a252e291'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.686228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] The token cache is being invalidate because project e76ca4c70d004bacb1426481e3ec596f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:02.686522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.687197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.688782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 966/1911] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:02 2022] DELETE /identity/v3/projects/e76ca4c70d004bacb1426481e3ec596f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:02.694743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:02.696490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:02.708111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23a345e27854e6bb21a0d00935012a9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.717149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23a345e27854e6bb21a0d00935012a9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.717894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23a345e27854e6bb21a0d00935012a9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.719274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23a345e27854e6bb21a0d00935012a9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.729858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:02.739862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1561394b-c0d8-4eb1-b5df-18b81070127a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23a345e27854e6bb21a0d00935012a9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.749511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:02.777267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c9621-9176-439d-8350-6d93a252e291 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:02.782067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:02.782983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:02.783348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:02.783619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] PATH_INFO: `/v3/users/90a7a9ce49784cf08b2d0a53767af6e1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:02.784916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a7a9ce49784cf08b2d0a53767af6e1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:02.786825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:02.825112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 946/1912] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:02 2022] DELETE /identity/v3/users/c23a345e27854e6bb21a0d00935012a9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:02.829547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:02.829842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:02.830124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:02.848080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:02.849272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:02.913583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 947/1913] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:02.925944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:02.925944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:02.947851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a7a9ce49784cf08b2d0a53767af6e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.958634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a7a9ce49784cf08b2d0a53767af6e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.959805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a7a9ce49784cf08b2d0a53767af6e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.961126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a7a9ce49784cf08b2d0a53767af6e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.973816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a7a9ce49784cf08b2d0a53767af6e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:02.989937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d1073-5384-4185-a999-f69fd1d56817 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:02.994551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:02.995258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:02.995696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:02.996011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:02.998089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:03.010649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:03.012111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:03.021782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 948/1914] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:03.062730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 967/1915] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:02 2022] DELETE /identity/v3/users/90a7a9ce49784cf08b2d0a53767af6e1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:03.544558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:03.546131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:03.571115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f880-3449-4517-a461-92b2b27d80bf service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:03.626455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:03.629272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:03.659576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:03.660485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:03.660778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:03.661049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] PATH_INFO: `/v3/projects/c4e09aa2e397446f9efa4d1494c2da0b` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:03.662339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e09aa2e397446f9efa4d1494c2da0b)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:03.664340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:03.716842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecb2e3-cf8a-424e-81e7-e24df82d55ab admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:03.721815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:03.726883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:03.726883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:03.726883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] PATH_INFO: `/v3/projects/aaadb09e12974d35a90cec0aa5ab1830` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:03.726883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaadb09e12974d35a90cec0aa5ab1830)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:03.726883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:03.747455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:03.764565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e09aa2e397446f9efa4d1494c2da0b', 'request_id': 'req-cefcba63-e91c-4afc-a621-20e8899fa8b5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.772418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e09aa2e397446f9efa4d1494c2da0b', 'request_id': 'req-cefcba63-e91c-4afc-a621-20e8899fa8b5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.852209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e09aa2e397446f9efa4d1494c2da0b', 'request_id': 'req-cefcba63-e91c-4afc-a621-20e8899fa8b5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.861396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaadb09e12974d35a90cec0aa5ab1830', 'request_id': 'req-aee41ed8-e803-4d9e-afdf-bf4456914f71'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.865333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] The token cache is being invalidate because project c4e09aa2e397446f9efa4d1494c2da0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:03.865333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.865333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.865684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 949/1916] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:03 2022] DELETE /identity/v3/projects/c4e09aa2e397446f9efa4d1494c2da0b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:03.869751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaadb09e12974d35a90cec0aa5ab1830', 'request_id': 'req-aee41ed8-e803-4d9e-afdf-bf4456914f71'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.870033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:03.871383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:03.874020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:03.939985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaadb09e12974d35a90cec0aa5ab1830', 'request_id': 'req-aee41ed8-e803-4d9e-afdf-bf4456914f71'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.941542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcba63-e91c-4afc-a621-20e8899fa8b5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:03.952427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] The token cache is being invalidate because project aaadb09e12974d35a90cec0aa5ab1830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:03.952649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.953300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-aee41ed8-e803-4d9e-afdf-bf4456914f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:03.954866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 968/1917] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:03 2022] DELETE /identity/v3/projects/aaadb09e12974d35a90cec0aa5ab1830 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:03.960698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45bee3-3d84-4f2d-a8b8-0513869911b2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:03.963148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45bee3-3d84-4f2d-a8b8-0513869911b2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:03.963148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45bee3-3d84-4f2d-a8b8-0513869911b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:03.979299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ae45bee3-3d84-4f2d-a8b8-0513869911b2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:03.980592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ae45bee3-3d84-4f2d-a8b8-0513869911b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:04.005772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.006709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.007610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.007826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] PATH_INFO: `/v3/users/8ff8e3110861441ba275c73fbd785b54` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.009036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff8e3110861441ba275c73fbd785b54)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.010992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.048086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 969/1918] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:04.056743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.057157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.057447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.077291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:04.078585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:04.086747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 970/1919] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:04.091075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.100176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc63f-50ce-4059-8465-75e3bad18e2f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.105449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.106121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.106395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.107406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.108157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:04.108593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.110255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.127425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 971/1920] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:04.128373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.140150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299438b-bf86-4d80-88a7-fdca078f3c63 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.144836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.145490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.145780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.146059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.146749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.148800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.198278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff8e3110861441ba275c73fbd785b54'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.205816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff8e3110861441ba275c73fbd785b54'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.206471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff8e3110861441ba275c73fbd785b54'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.207102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff8e3110861441ba275c73fbd785b54'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.214216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:04.219413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff8e3110861441ba275c73fbd785b54'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.272785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 972/1921] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:04 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:04.277047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.278705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:04.293776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 950/1922] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:03 2022] DELETE /identity/v3/users/8ff8e3110861441ba275c73fbd785b54 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:04.350249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17732-f6b3-45ef-9cb1-e152a0688f76 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.399255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:04.411697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.412431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.412753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.413544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.414275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.416317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.513585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 973/1923] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:04 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:04.517782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.526151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62f989-315e-40d3-90de-63371195bccd admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.530738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.531534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.531718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.531992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.532725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.534606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.546713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 951/1924] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:04.551805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.562135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af99ea-87d7-423b-8ec8-82ee40195cf5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.567107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d25c-b593-44da-be2c-242f3ee6ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.571459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d25c-b593-44da-be2c-242f3ee6ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.571459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d25c-b593-44da-be2c-242f3ee6ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.571459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d25c-b593-44da-be2c-242f3ee6ab69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.571459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d25c-b593-44da-be2c-242f3ee6ab69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.571964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d25c-b593-44da-be2c-242f3ee6ab69 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.587420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 974/1925] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:04.588885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.598836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06992c-ac74-4b45-b7a2-113df0a45b33 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.603923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.604808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.605092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.605365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] PATH_INFO: `/v3/projects/249e7448033c4b09b08fc7610141ab0d/users/361cf22900b048b790494ac7cd321ad2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.620489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=249e7448033c4b09b08fc7610141ab0d, user_id=361cf22900b048b790494ac7cd321ad2, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.623137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.706391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 952/1926] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:04 2022] PUT /identity/v3/projects/249e7448033c4b09b08fc7610141ab0d/users/361cf22900b048b790494ac7cd321ad2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:04.718539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.719062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.719169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.735106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.740716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:04.755450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] MFA Rules not processed for user `361cf22900b048b790494ac7cd321ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:04.756720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:04.839010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2caef1-549d-4f58-abf9-3eaa05c421cb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.843881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.844753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.845037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.845315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] PATH_INFO: `/v3/projects/09f7cd1a3057497797d51b23912a7aa3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.846541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f7cd1a3057497797d51b23912a7aa3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.848485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.858606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 975/1927] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:04.870661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.872162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:04.932119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ae2d3-9d53-4594-8829-8c667fc46128 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:04.935804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:04.936459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:04.936796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:04.937076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:04.945430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:04.946857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:04.956298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 976/1928] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:04.962990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f7cd1a3057497797d51b23912a7aa3', 'request_id': 'req-6850e7d1-48dc-40dc-862f-adc2cbd8312b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.975340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:04.977251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f7cd1a3057497797d51b23912a7aa3', 'request_id': 'req-6850e7d1-48dc-40dc-862f-adc2cbd8312b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:04.988214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b10a0e-80fe-489b-99fb-28a9fe64cf11 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.036016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f7cd1a3057497797d51b23912a7aa3', 'request_id': 'req-6850e7d1-48dc-40dc-862f-adc2cbd8312b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.047225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.047810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] The token cache is being invalidate because project 09f7cd1a3057497797d51b23912a7aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:05.048149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.048260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.048554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.048822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6850e7d1-48dc-40dc-862f-adc2cbd8312b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.048919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] PATH_INFO: `/v3/users/361cf22900b048b790494ac7cd321ad2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.049999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361cf22900b048b790494ac7cd321ad2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.050623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 953/1929] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:04 2022] DELETE /identity/v3/projects/09f7cd1a3057497797d51b23912a7aa3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:05.052088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.056572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6cc89-ef55-4f3e-a1f1-6e3243190637 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.056872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6cc89-ef55-4f3e-a1f1-6e3243190637 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.057153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6cc89-ef55-4f3e-a1f1-6e3243190637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.061528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:05.074872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8de6cc89-ef55-4f3e-a1f1-6e3243190637 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:05.076139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8de6cc89-ef55-4f3e-a1f1-6e3243190637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:05.084528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 954/1930] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:05.091775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.092071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.092354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.111917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:05.115147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:05.122993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 955/1931] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:05.126911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.135987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7721-f67c-483d-b96b-f952e7286e81 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.141063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.143869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.143869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.143869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.143869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:05.143869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.144846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.156734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 956/1932] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:05.162867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.175766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c407-7ede-4778-8f0a-9ef948cd573c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.181497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.182207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.182552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.182971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.183809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.186075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.195009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:05.266408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361cf22900b048b790494ac7cd321ad2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.273594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361cf22900b048b790494ac7cd321ad2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.274348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361cf22900b048b790494ac7cd321ad2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.274959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361cf22900b048b790494ac7cd321ad2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.288900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2222378f-ed05-4e92-bb4c-28583c052f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361cf22900b048b790494ac7cd321ad2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:05.291704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 957/1933] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:05.297253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.298981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:05.360727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32ffd-d99d-4d4b-a5c4-7308a75e3f3d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.365377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.366070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.366369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.366643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.367361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.369287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.402199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 977/1934] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:04 2022] DELETE /identity/v3/users/361cf22900b048b790494ac7cd321ad2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:05.406615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.406906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.407187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.424302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:05.425489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:05.474882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 958/1935] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:05.479145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.488354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 978/1936] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:05.493532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99736e-6480-44a9-b659-8dd1585dfa3b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.496707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.498017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.501558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:05.501664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.501664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.501664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.501664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.501664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.516102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 959/1937] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:05.517201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.527514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb4bd-0c65-4363-9ca9-1c6a134374f2 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.532442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.533098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.533388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.533667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.534385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.536066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.546375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 960/1938] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:05.550131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.560067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4abeaf-2f92-4aa7-adea-3ddd10e1185b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.560214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7f8c-fef5-4459-8928-128fef4fd726 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.563715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72342dce-cb60-444d-8839-231ea6a531c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.564371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342dce-cb60-444d-8839-231ea6a531c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.564655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342dce-cb60-444d-8839-231ea6a531c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.564900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.565024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342dce-cb60-444d-8839-231ea6a531c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.565772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.566056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.566333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] PATH_INFO: `/v3/projects/d9d4cbe572424f07b71556860c3b1847/users/71a2cd6be46248deb3ab84f38b1ff91c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.574805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342dce-cb60-444d-8839-231ea6a531c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.576285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342dce-cb60-444d-8839-231ea6a531c3 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.581576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d4cbe572424f07b71556860c3b1847, user_id=71a2cd6be46248deb3ab84f38b1ff91c, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.584275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:05.585764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 979/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:05.682662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 961/1940] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:05 2022] PUT /identity/v3/projects/d9d4cbe572424f07b71556860c3b1847/users/71a2cd6be46248deb3ab84f38b1ff91c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:05.692951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.693240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.693513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.719628 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] MFA Rules not processed for user `71a2cd6be46248deb3ab84f38b1ff91c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:05.720992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:05.734059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:05.790862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 980/1941] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:05.795745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:05.889878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0589ad8-41b3-4804-beac-4909e367e777 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:05.895389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:05.896318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:05.896807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:05.897309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:05.898299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:05.900921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.007414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.010160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:06.025436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79396-fa7d-46a9-aceb-ce4a0e5a7b96 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.030328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.031201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.033098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.033098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] PATH_INFO: `/v3/projects/249e7448033c4b09b08fc7610141ab0d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.033098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=249e7448033c4b09b08fc7610141ab0d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.034991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.037477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 962/1942] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:06.042021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.063775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:06.104961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550257-10f6-4106-a9ad-4047f8055b1f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.113603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.113603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.113603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.113603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.113954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.113954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.151592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249e7448033c4b09b08fc7610141ab0d', 'request_id': 'req-45d8954c-983d-4b2d-868e-53f021cb6d1a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:06.158164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249e7448033c4b09b08fc7610141ab0d', 'request_id': 'req-45d8954c-983d-4b2d-868e-53f021cb6d1a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:06.228665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 963/1943] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:06.235178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.245105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a677f-dcab-4ce5-91ee-3cbd59b96662 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.251378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249e7448033c4b09b08fc7610141ab0d', 'request_id': 'req-45d8954c-983d-4b2d-868e-53f021cb6d1a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:06.263625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] The token cache is being invalidate because project 249e7448033c4b09b08fc7610141ab0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:06.263918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:06.264549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-45d8954c-983d-4b2d-868e-53f021cb6d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:06.266097 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 981/1944] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:06 2022] DELETE /identity/v3/projects/249e7448033c4b09b08fc7610141ab0d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:06.271052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805153cc-2f3b-4337-b487-4dd36a505a04 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.271436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805153cc-2f3b-4337-b487-4dd36a505a04 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.271788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805153cc-2f3b-4337-b487-4dd36a505a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.291026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-805153cc-2f3b-4337-b487-4dd36a505a04 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:06.292363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-805153cc-2f3b-4337-b487-4dd36a505a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:06.305387 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.306068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.306353 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.306631 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.307398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.309089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.320208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 964/1945] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:06.324391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.326006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:06.338889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3aa0-56bb-4ec9-bbf9-b7a1d9535f26 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.343661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.344524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.344809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.345091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] PATH_INFO: `/v3/projects/cdb6115c1e1d458b8052a189f8d2ed38/users/4a1d95d266cb4da8b388e17b22cac0a7/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.355397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 982/1946] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:06.360973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb6115c1e1d458b8052a189f8d2ed38, user_id=4a1d95d266cb4da8b388e17b22cac0a7, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.362821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.363116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.363431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.363660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.382324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:06.383547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:06.391730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 983/1947] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:06.396171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.405635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501256c4-2379-4db6-a812-4272dffe80f5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.410273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.410901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.411187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.411492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.412206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:06.412562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.414653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.425928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 984/1948] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:06.430604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.440107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd497e-4ff8-478a-bd45-b8840451708e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.444866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.445483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.445766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.446043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.446716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.447714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 965/1949] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:06 2022] PUT /identity/v3/projects/cdb6115c1e1d458b8052a189f8d2ed38/users/4a1d95d266cb4da8b388e17b22cac0a7/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:06.448606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.451610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.512663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635af44-4885-4e9a-b43c-4db3eec15904 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.517412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.518075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.518413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.518691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.519441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.520372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:06.521049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.528103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 985/1950] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:06.532127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.537181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 966/1951] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:06.541449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.551098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a294-2777-4df2-a89c-9f328a17d318 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.563669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:06.595421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512af97-1804-408a-953e-53d347aa1433 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.600210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.601398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.601682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.601960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.602691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.604660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.607795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93265-cc8a-48ff-adbd-6ac656b5b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.608713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93265-cc8a-48ff-adbd-6ac656b5b835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.612104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93265-cc8a-48ff-adbd-6ac656b5b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.612104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93265-cc8a-48ff-adbd-6ac656b5b835 admin admin] PATH_INFO: `/v3/projects/cdb6115c1e1d458b8052a189f8d2ed38/users/4a1d95d266cb4da8b388e17b22cac0a7/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.612104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93265-cc8a-48ff-adbd-6ac656b5b835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb6115c1e1d458b8052a189f8d2ed38, user_id=4a1d95d266cb4da8b388e17b22cac0a7, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.613993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93265-cc8a-48ff-adbd-6ac656b5b835 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.624699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 967/1952] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:06 2022] PUT /identity/v3/projects/cdb6115c1e1d458b8052a189f8d2ed38/users/4a1d95d266cb4da8b388e17b22cac0a7/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:06.635490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.635781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.636056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.663897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] MFA Rules not processed for user `4a1d95d266cb4da8b388e17b22cac0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:06.665079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:06.716315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 986/1953] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:06.720373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.731129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d4d7f-714d-4913-a3d0-35923bf65472 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.733612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 968/1954] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:06.744665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.746012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:06.786964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.787673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.788618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.788907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.789673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.791351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.801070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 987/1955] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:06.805162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9c28e-1711-4147-b8b2-c1e7bd0405b5 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.805359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.808850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.809507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.809796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.810074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.815030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1602ed-07ce-4e7c-9b5f-ed8bfdee7548 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.821034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7a1ba-f63a-4103-883d-775aaf4cfe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.821569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.821837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7a1ba-f63a-4103-883d-775aaf4cfe01 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.822186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7a1ba-f63a-4103-883d-775aaf4cfe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.822527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7a1ba-f63a-4103-883d-775aaf4cfe01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.823020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.823438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7a1ba-f63a-4103-883d-775aaf4cfe01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.825084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7a1ba-f63a-4103-883d-775aaf4cfe01 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.833001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 969/1956] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:06.839208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 988/1957] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:06.842642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:06.853433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd04ff-f006-4c94-b833-e0596a142224 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:06.858059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:06.859012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.859328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.859607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] PATH_INFO: `/v3/projects/7f96bf275668483693b201f24c5be5dd/users/21d0f4e01c0743868615bb73b622d961/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.873941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f96bf275668483693b201f24c5be5dd, user_id=21d0f4e01c0743868615bb73b622d961, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:06.876679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:06.951146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 970/1958] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:06 2022] PUT /identity/v3/projects/7f96bf275668483693b201f24c5be5dd/users/21d0f4e01c0743868615bb73b622d961/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:06.962818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:06.963260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:06.963812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:06.991740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] MFA Rules not processed for user `21d0f4e01c0743868615bb73b622d961`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:06.992951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:07.068392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 989/1959] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:07.075404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:07.077112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:07.093061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:07.149147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d3f4-6bca-4fab-9196-7c0bd4472046 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:07.153955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdec8-db0c-4e1c-be46-a18589932266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:07.154625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdec8-db0c-4e1c-be46-a18589932266 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:07.154969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdec8-db0c-4e1c-be46-a18589932266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:07.155264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdec8-db0c-4e1c-be46-a18589932266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:07.164946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cdec8-db0c-4e1c-be46-a18589932266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:07.166441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cdec8-db0c-4e1c-be46-a18589932266 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:07.176699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 971/1960] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:08.108050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:08.112326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:08.171954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057bd29-4352-4d99-bd11-ae57b204beff None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:08.177130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:08.178438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:08.179562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:08.179984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] PATH_INFO: `/v3/users/71a2cd6be46248deb3ab84f38b1ff91c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:08.181377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a2cd6be46248deb3ab84f38b1ff91c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:08.185954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:08.355869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a2cd6be46248deb3ab84f38b1ff91c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:08.379767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a2cd6be46248deb3ab84f38b1ff91c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:08.379767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a2cd6be46248deb3ab84f38b1ff91c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:08.379767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a2cd6be46248deb3ab84f38b1ff91c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:08.389941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a2cd6be46248deb3ab84f38b1ff91c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:08.491965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 990/1961] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:08 2022] DELETE /identity/v3/users/71a2cd6be46248deb3ab84f38b1ff91c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:08.496481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:08.496990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:08.497086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:08.516308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:08.517763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:08.578319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 972/1962] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:08.589119 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:08.590665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:08.651865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f26258-847e-4cc8-b9c2-793258b23afb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:08.656262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:08.657345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:08.657648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:08.657935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:08.673832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:08.681972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:08.689040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 991/1963] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:09.180112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:09.183149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:09.193448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab1739-e247-4a8a-9830-463d06e54ded None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:09.198373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:09.199253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:09.199539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:09.200051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] PATH_INFO: `/v3/projects/d9d4cbe572424f07b71556860c3b1847` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:09.202203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d4cbe572424f07b71556860c3b1847)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:09.204135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:09.296238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d4cbe572424f07b71556860c3b1847', 'request_id': 'req-fbf93c37-ef0d-4b06-973f-d8993026964c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.308154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d4cbe572424f07b71556860c3b1847', 'request_id': 'req-fbf93c37-ef0d-4b06-973f-d8993026964c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.448108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d4cbe572424f07b71556860c3b1847', 'request_id': 'req-fbf93c37-ef0d-4b06-973f-d8993026964c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.460532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] The token cache is being invalidate because project d9d4cbe572424f07b71556860c3b1847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:09.460811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.462050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.464018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 973/1964] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:09 2022] DELETE /identity/v3/projects/d9d4cbe572424f07b71556860c3b1847 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:09.468275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:09.483050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1796a5-38e3-4c93-a9fc-b1a49b77c215 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:09.513052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:09.555734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:09.556652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:09.556935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:09.557310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] PATH_INFO: `/v3/users/4a1d95d266cb4da8b388e17b22cac0a7` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:09.558700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1d95d266cb4da8b388e17b22cac0a7)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:09.560750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:09.751138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1d95d266cb4da8b388e17b22cac0a7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.762732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1d95d266cb4da8b388e17b22cac0a7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.762732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1d95d266cb4da8b388e17b22cac0a7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.762732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1d95d266cb4da8b388e17b22cac0a7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.774063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c0156c0c-02c4-48cc-a2a9-f3ec5210097f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1d95d266cb4da8b388e17b22cac0a7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:09.857903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 992/1965] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:09 2022] DELETE /identity/v3/users/4a1d95d266cb4da8b388e17b22cac0a7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:10.301565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:10.303115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:10.318152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93c37-ef0d-4b06-973f-d8993026964c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:10.364777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:10.383575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:10.384451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:10.384735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:10.385013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] PATH_INFO: `/v3/projects/cdb6115c1e1d458b8052a189f8d2ed38` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:10.386238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb6115c1e1d458b8052a189f8d2ed38)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:10.388456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:10.501085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb6115c1e1d458b8052a189f8d2ed38', 'request_id': 'req-e7804de6-4210-41ce-877b-3374ef67175a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:10.507908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb6115c1e1d458b8052a189f8d2ed38', 'request_id': 'req-e7804de6-4210-41ce-877b-3374ef67175a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:10.584427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb6115c1e1d458b8052a189f8d2ed38', 'request_id': 'req-e7804de6-4210-41ce-877b-3374ef67175a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:10.598671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] The token cache is being invalidate because project cdb6115c1e1d458b8052a189f8d2ed38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:10.599310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:10.599776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e7804de6-4210-41ce-877b-3374ef67175a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:10.602280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 974/1966] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:10 2022] DELETE /identity/v3/projects/cdb6115c1e1d458b8052a189f8d2ed38 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:10.607264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:10.607703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:10.607892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:10.629778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:10.631169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:10.700665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 993/1967] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:10.708656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:10.708656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:10.708885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:10.729591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:10.730836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:10.739434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 975/1968] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:10.743816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:10.754252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0aa7-563f-42db-ad18-dc321c02ef37 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:10.759027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:10.759824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:10.760211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:10.760558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:10.761367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:10.761747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:10.764083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:10.776813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 994/1969] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:10.781171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:10.792416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccb7ad-014f-4be8-97d6-9d1d862bdbb7 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:10.801969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:10.802730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:10.803016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:10.803345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:10.804079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:10.806000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:10.884181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 976/1970] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:10 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:10.888569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:10.899254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7b392-8ef7-47f9-87b1-ef2df948b59f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:10.928556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:10.956561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:10.957237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:10.957520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:10.957803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:10.958576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:10.962073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:11.046723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 995/1971] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:10 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:11.050545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:11.061066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8f36d-f798-41e3-97f9-11f23f554ae4 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:11.065695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:11.069701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:11.069701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:11.069701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:11.069701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:11.070052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:11.080137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 977/1972] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:11.084352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:11.095854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d47e1-9abd-4880-80f0-f8eae92a232e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:11.100604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7717b31-7d72-4b39-a808-c434c79b8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:11.101273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7717b31-7d72-4b39-a808-c434c79b8adc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:11.101561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7717b31-7d72-4b39-a808-c434c79b8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:11.101842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7717b31-7d72-4b39-a808-c434c79b8adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:11.102584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7717b31-7d72-4b39-a808-c434c79b8adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:11.104242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7717b31-7d72-4b39-a808-c434c79b8adc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:11.114105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 996/1973] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:11.118477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:11.128561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531f41d-13e8-4af3-aa0c-15d7e6104144 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:11.133766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:11.134646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:11.134929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:11.135206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] PATH_INFO: `/v3/projects/f835785be0684dc7a270a89a093e9609/users/75b429eb57bd41baaa1a0952ca63eeab/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:11.150850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f835785be0684dc7a270a89a093e9609, user_id=75b429eb57bd41baaa1a0952ca63eeab, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:11.153921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:11.224021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 978/1974] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:11 2022] PUT /identity/v3/projects/f835785be0684dc7a270a89a093e9609/users/75b429eb57bd41baaa1a0952ca63eeab/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:11.224799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce59122-051b-4f2d-8859-efa1afd95adf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:11.225097 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce59122-051b-4f2d-8859-efa1afd95adf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:11.225444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce59122-051b-4f2d-8859-efa1afd95adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:11.243871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7ce59122-051b-4f2d-8859-efa1afd95adf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:11.245091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7ce59122-051b-4f2d-8859-efa1afd95adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:11.305311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 997/1975] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:11.314843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:11.316531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:11.374768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911972e9-08f9-4723-af4e-8848e54304d0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:11.378377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:11.379030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:11.379352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:11.379633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:11.389291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:11.390715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:11.399964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 979/1976] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:12.578568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0fa1-0590-4fa8-af44-9c602f0ca955 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:12.579034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0fa1-0590-4fa8-af44-9c602f0ca955 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:12.579123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0fa1-0590-4fa8-af44-9c602f0ca955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:12.608039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5deb0fa1-0590-4fa8-af44-9c602f0ca955 None None] MFA Rules not processed for user `75b429eb57bd41baaa1a0952ca63eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:12.609257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5deb0fa1-0590-4fa8-af44-9c602f0ca955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:12.680812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 998/1977] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:12.688226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:12.689701 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:12.703260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:12.748135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015609-8e70-4996-bcaf-05e5bf09f6b3 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:12.751764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:12.752541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:12.752905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:12.753271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:12.764064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:12.767626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:12.774921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 980/1978] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:15.463729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d71ef-2bc8-4b84-a815-7b6cc0fc67c3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:15.464212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d71ef-2bc8-4b84-a815-7b6cc0fc67c3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:15.464303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d71ef-2bc8-4b84-a815-7b6cc0fc67c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:15.481800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-713d71ef-2bc8-4b84-a815-7b6cc0fc67c3 None None] MFA Rules not processed for user `75b429eb57bd41baaa1a0952ca63eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:15.483005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-713d71ef-2bc8-4b84-a815-7b6cc0fc67c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:15.490314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 999/1979] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:16.092409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:16.093861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:16.108253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a540a-cb34-4a9e-a0bf-de37be7d7e4f service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:16.112766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:16.113661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:16.113949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:16.114237 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] PATH_INFO: `/v3/users/3fa6ac6f8de54472b4608708ceed2269` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:16.115441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa6ac6f8de54472b4608708ceed2269)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:16.117973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:16.319448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa6ac6f8de54472b4608708ceed2269'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:16.326505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa6ac6f8de54472b4608708ceed2269'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:16.327185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa6ac6f8de54472b4608708ceed2269'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:16.327824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa6ac6f8de54472b4608708ceed2269'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:16.340498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa6ac6f8de54472b4608708ceed2269'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:16.436361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 981/1980] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:16 2022] DELETE /identity/v3/users/3fa6ac6f8de54472b4608708ceed2269 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:16.440844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:16.441135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:16.441415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:16.458234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:16.459449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:16.488129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:16.517707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1000/1981] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:16.527743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:16.529144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:16.587179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560473a-5213-41a9-8482-9d9825e6c5de admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:16.590844 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:16.591526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:16.591816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:16.592094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:16.601703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:16.603137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:16.612678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 982/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:17.081203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:17.082735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:17.095690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1026acc-9869-40d6-a5e2-804f6a1ae454 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:17.100382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:17.102145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:17.102634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:17.102925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] PATH_INFO: `/v3/projects/e9f83fda27fa48c287ef116fe0d32bb7` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:17.104271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f83fda27fa48c287ef116fe0d32bb7)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:17.106257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:17.310439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f83fda27fa48c287ef116fe0d32bb7', 'request_id': 'req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.317063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f83fda27fa48c287ef116fe0d32bb7', 'request_id': 'req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.383148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f83fda27fa48c287ef116fe0d32bb7', 'request_id': 'req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.397139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] The token cache is being invalidate because project e9f83fda27fa48c287ef116fe0d32bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:17.397139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.397139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.397402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1001/1983] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:17 2022] DELETE /identity/v3/projects/e9f83fda27fa48c287ef116fe0d32bb7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:17.401372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:17.411091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc702ec-2112-49d0-a19e-11b84576493e service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:17.435021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:17.472475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:17.473407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:17.473696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:17.473973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] PATH_INFO: `/v3/users/a2e2791df64e495d94f10dca5e124682` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:17.475198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e2791df64e495d94f10dca5e124682)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:17.477245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:17.643419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e2791df64e495d94f10dca5e124682'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.650378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e2791df64e495d94f10dca5e124682'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.651051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e2791df64e495d94f10dca5e124682'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.651690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e2791df64e495d94f10dca5e124682'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.664444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f4f173de-f32f-4044-a292-c5f183d206aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e2791df64e495d94f10dca5e124682'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:17.744739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 983/1984] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:17 2022] DELETE /identity/v3/users/a2e2791df64e495d94f10dca5e124682 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:18.140526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:18.142797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:18.157137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3272f-a73b-4e0c-876b-e35c3c0cf7fb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:18.231445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:18.231445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.231445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.231445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] PATH_INFO: `/v3/projects/ffd6908aa603445aafb27e3ff1987f1c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.231804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd6908aa603445aafb27e3ff1987f1c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:18.232503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:18.355092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd6908aa603445aafb27e3ff1987f1c', 'request_id': 'req-cb894398-7031-4b09-9599-50ed6a9baf0c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:18.363426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd6908aa603445aafb27e3ff1987f1c', 'request_id': 'req-cb894398-7031-4b09-9599-50ed6a9baf0c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:18.365775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:18.451177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd6908aa603445aafb27e3ff1987f1c', 'request_id': 'req-cb894398-7031-4b09-9599-50ed6a9baf0c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:18.463810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] The token cache is being invalidate because project ffd6908aa603445aafb27e3ff1987f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:18.464109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:18.464813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cb894398-7031-4b09-9599-50ed6a9baf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:18.466362 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1002/1985] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:18 2022] DELETE /identity/v3/projects/ffd6908aa603445aafb27e3ff1987f1c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:18.471421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.471890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.472107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.490799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:18.494050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:18.554981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 984/1986] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:18.562751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.562980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.563280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.582226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:18.583482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:18.592063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1003/1987] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:18.596279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:18.605939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18090b6e-3fe3-46d5-bf00-2d0c4c4dfdbf None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:18.610550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:18.611214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.612802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.612802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.612802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:18.613090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:18.614435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:18.625855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 985/1988] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:18.630065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:18.639974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a50b-2f65-473a-acd3-fcc01670b22e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:18.645728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:18.646398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.646665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.646942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.648300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:18.650208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:18.734394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1004/1989] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:18 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:18.738521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:18.749624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667592-a817-4ae9-bdad-9c27bd6d5e96 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:18.779598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:18.805112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:18.805783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.806068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.806344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.807045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:18.809045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:18.942182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 986/1990] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:18 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:18.943396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:18.954366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c6fa7-a93c-4a96-930a-2f74f60e4f9b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:18.958986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:18.959786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.960101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.960877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.961605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:18.963257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:18.973650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1005/1991] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:18.978300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:18.988481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15404df8-d8a2-40da-be3a-1dcbbd99016f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:18.993272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d6d43-4220-4967-a628-70efd1ac6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:18.993933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d6d43-4220-4967-a628-70efd1ac6123 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:18.994259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d6d43-4220-4967-a628-70efd1ac6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:18.994629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d6d43-4220-4967-a628-70efd1ac6123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:18.995411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d6d43-4220-4967-a628-70efd1ac6123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:18.997063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d6d43-4220-4967-a628-70efd1ac6123 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.006993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 987/1992] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:19.010932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.021298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9082c-33a8-4b12-bced-fd4a2fb79699 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.026399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.027314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.027605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.027913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] PATH_INFO: `/v3/projects/d939afd9c059458c9de1245a15994373/users/02cd9bdf276f48418c2558a7b920f67d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.042793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d939afd9c059458c9de1245a15994373, user_id=02cd9bdf276f48418c2558a7b920f67d, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.045495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.156160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1006/1993] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:19 2022] PUT /identity/v3/projects/d939afd9c059458c9de1245a15994373/users/02cd9bdf276f48418c2558a7b920f67d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:19.166404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.166805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.167091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.193252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] MFA Rules not processed for user `02cd9bdf276f48418c2558a7b920f67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:19.195000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:19.265174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 988/1994] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:19.275470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.343096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345a26b-5977-48a7-ae1d-85d3a50c3f70 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.348148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.348815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.349096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.349372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.350071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.352224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.441324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1007/1995] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:19 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:19.441665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.451549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16967dda-cd91-44f0-9ba1-edc96bc55434 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.521797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.523007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.523412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.523789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.524791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.528029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.603206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 989/1996] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:19 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:19.607069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.618232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f34d9-c09e-44c4-bfd8-23e9928db2eb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.622858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.623598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.623888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.624294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.625036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.626656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.638834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1008/1997] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:19.642790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.675707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d1d3-6ba5-4f1d-958b-877b2bc137bd admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.692622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.693741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.694033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.694314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] PATH_INFO: `/v3/projects/479fbf8b697b4ca38f7273fc6c00038c/users/0b05d094312947fea1ec098326f7f45c/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.724848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479fbf8b697b4ca38f7273fc6c00038c, user_id=0b05d094312947fea1ec098326f7f45c, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.727695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.785419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 990/1998] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:19 2022] PUT /identity/v3/projects/479fbf8b697b4ca38f7273fc6c00038c/users/0b05d094312947fea1ec098326f7f45c/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:19.789854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.799974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f3ef-64ef-4c2b-adc9-11ecc35596d9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.854841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:19.861311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c453e3-2b08-4311-9ddd-00a07542a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.862164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c453e3-2b08-4311-9ddd-00a07542a871 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.862677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c453e3-2b08-4311-9ddd-00a07542a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.862899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c453e3-2b08-4311-9ddd-00a07542a871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.863814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c453e3-2b08-4311-9ddd-00a07542a871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.865454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c453e3-2b08-4311-9ddd-00a07542a871 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.883493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1009/1999] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:19.884802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:19.898233 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08489-2356-4497-95a9-f8420eef5fb6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:19.904762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:19.906532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.906532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.906764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] PATH_INFO: `/v3/projects/479fbf8b697b4ca38f7273fc6c00038c/users/0b05d094312947fea1ec098326f7f45c/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.909781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479fbf8b697b4ca38f7273fc6c00038c, user_id=0b05d094312947fea1ec098326f7f45c, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:19.911996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:19.925295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:19.934909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 991/2000] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:19 2022] PUT /identity/v3/projects/479fbf8b697b4ca38f7273fc6c00038c/users/0b05d094312947fea1ec098326f7f45c/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:19.949612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:19.949976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:19.950334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:19.981693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] MFA Rules not processed for user `0b05d094312947fea1ec098326f7f45c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:19.982988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:20.063809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1010/2001] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:20.075676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:20.077617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:20.136733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4501bd-5dc2-4f6e-9fb0-d7e6b19dabb0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:20.140708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8f241-00f6-44b2-9775-094946c946c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:20.141501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8f241-00f6-44b2-9775-094946c946c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:20.146291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8f241-00f6-44b2-9775-094946c946c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:20.146291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8f241-00f6-44b2-9775-094946c946c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:20.151429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8f241-00f6-44b2-9775-094946c946c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:20.152869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8f241-00f6-44b2-9775-094946c946c0 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:20.162416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 992/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:20.410531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:20.422266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ae5b-4395-4382-91ea-34dc14eabe18 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:20.426976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deada95-62d8-45ac-ac84-7cfe5a5af024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:20.427749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deada95-62d8-45ac-ac84-7cfe5a5af024 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:20.427997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deada95-62d8-45ac-ac84-7cfe5a5af024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:20.428420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deada95-62d8-45ac-ac84-7cfe5a5af024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:20.496305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deada95-62d8-45ac-ac84-7cfe5a5af024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:20.497903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deada95-62d8-45ac-ac84-7cfe5a5af024 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:20.509795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1011/2003] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:26.193607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2102bd-524b-447c-bfdc-3532362d4daf None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:26.194158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2102bd-524b-447c-bfdc-3532362d4daf None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:26.194437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2102bd-524b-447c-bfdc-3532362d4daf None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:26.196067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 993/2004] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:12:26.222832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:26.223707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:26.223990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:26.242976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:26.244294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:26.306909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1012/2005] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:12:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:26.325215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2102bd-524b-447c-bfdc-3532362d4daf None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:26.325215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0a2102bd-524b-447c-bfdc-3532362d4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:26.326728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:26.329510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:26.344573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:26.347556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2102bd-524b-447c-bfdc-3532362d4daf None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:26.353366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:26.358580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:26.358580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:26.358580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:26.363075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:26.364686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:26.375740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 994/2006] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:26.400550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07e94-ea15-4110-97a4-cbba43b69dda None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:26.406003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:26.406945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:26.407258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:26.407556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] PATH_INFO: `/v3/users/c99330cccfea41abbb7bc5b34956c612` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:26.408886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99330cccfea41abbb7bc5b34956c612)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:26.414499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:26.576640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99330cccfea41abbb7bc5b34956c612'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:26.583688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99330cccfea41abbb7bc5b34956c612'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:26.584617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99330cccfea41abbb7bc5b34956c612'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:26.585258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99330cccfea41abbb7bc5b34956c612'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:26.597321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-dd078a57-a5c8-4904-95ea-4751e52e6e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99330cccfea41abbb7bc5b34956c612'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:26.672700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1013/2007] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:26 2022] DELETE /identity/v3/users/c99330cccfea41abbb7bc5b34956c612 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:27.071275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.083622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43559ac-dadf-43ca-bba9-31d409627973 service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.140272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.141130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.141411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.141688 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] PATH_INFO: `/v3/projects/088ecec3bdbf404fa8474235018235ca` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.143024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=088ecec3bdbf404fa8474235018235ca)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.144949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:27.270187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088ecec3bdbf404fa8474235018235ca', 'request_id': 'req-46c6f9d5-4944-489a-aaa2-2505880d4bed'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:27.276788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088ecec3bdbf404fa8474235018235ca', 'request_id': 'req-46c6f9d5-4944-489a-aaa2-2505880d4bed'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:27.364912 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088ecec3bdbf404fa8474235018235ca', 'request_id': 'req-46c6f9d5-4944-489a-aaa2-2505880d4bed'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:27.375600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] The token cache is being invalidate because project 088ecec3bdbf404fa8474235018235ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:27.375892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:27.376520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46c6f9d5-4944-489a-aaa2-2505880d4bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:27.378159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 995/2008] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:27 2022] DELETE /identity/v3/projects/088ecec3bdbf404fa8474235018235ca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:27.383719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.384164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.384299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.402260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:27.403486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:27.463211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1014/2009] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:27.473870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.474183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.474463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.492635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:27.493848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:27.502339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 996/2010] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:27.506367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.516815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca3226-9e5d-41db-910f-2b1854ad64d2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.521458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.522116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.523001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.523530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.524288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:27.524620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.526254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:27.537734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1015/2011] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:27.542056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.551572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b0738-4d87-47cd-aa18-0f5dcca59b68 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.556487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.557156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.557441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.557718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.558518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.560476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:27.563752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:27.671617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 997/2012] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:27 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:27.675774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.685744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21460ba-7c65-40fe-a351-8b8702a25018 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.702912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:27.743687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.745005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.745350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.745588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.746308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.748261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:27.870743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1016/2013] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:27 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:27.874839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.886177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc054a5-543f-4bd5-a542-dababa93ca55 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.890965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.891652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.891935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.892207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.893077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.894564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:27.904603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 998/2014] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:27.908656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.918753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79b4e-7efa-4ff4-9f1b-d1e45502cfe8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.925200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330066ea-d9cd-4441-95f3-6c2c423f8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.925951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330066ea-d9cd-4441-95f3-6c2c423f8f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.926241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330066ea-d9cd-4441-95f3-6c2c423f8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.926519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330066ea-d9cd-4441-95f3-6c2c423f8f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.927617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330066ea-d9cd-4441-95f3-6c2c423f8f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.929409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330066ea-d9cd-4441-95f3-6c2c423f8f4f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:27.939782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1017/2015] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:27.943851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:27.954433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517fb3f-f63e-4a19-a408-190a6bad3b2c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:27.959114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:27.960031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:27.962410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:27.962410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] PATH_INFO: `/v3/projects/988f75d3d5104f008193c60e2e38faef/users/aca01b6a14944e75a7ff3643003afe4e/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:27.975229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988f75d3d5104f008193c60e2e38faef, user_id=aca01b6a14944e75a7ff3643003afe4e, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:27.977971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:28.071908 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 999/2016] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:27 2022] PUT /identity/v3/projects/988f75d3d5104f008193c60e2e38faef/users/aca01b6a14944e75a7ff3643003afe4e/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:28.082188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:28.082490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:28.082751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:28.119725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] MFA Rules not processed for user `aca01b6a14944e75a7ff3643003afe4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:28.126153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:28.205627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1018/2017] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:28.213532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:28.215383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:28.275472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1471d12-a735-4bcd-b94f-56ccee800d14 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:28.279083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e8bc-e97f-4b9f-822e-88bc1d9d535a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:28.279776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e8bc-e97f-4b9f-822e-88bc1d9d535a service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:28.280059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e8bc-e97f-4b9f-822e-88bc1d9d535a service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:28.280334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e8bc-e97f-4b9f-822e-88bc1d9d535a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:28.289024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e8bc-e97f-4b9f-822e-88bc1d9d535a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:28.290446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e8bc-e97f-4b9f-822e-88bc1d9d535a service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:28.299148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1000/2018] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:32.509670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:32.511106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:32.590519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80053-7390-49c7-9371-58d777f1c224 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:32.595197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:32.596143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:32.596429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:32.596711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] PATH_INFO: `/v3/users/5cdf3cd10df148439670673d38f764ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:32.598000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdf3cd10df148439670673d38f764ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:32.599906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:32.796398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:32.821033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdf3cd10df148439670673d38f764ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:32.828594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdf3cd10df148439670673d38f764ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:32.831512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdf3cd10df148439670673d38f764ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:32.831512 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdf3cd10df148439670673d38f764ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:32.843126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdf3cd10df148439670673d38f764ce'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:32.923482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1019/2019] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:32 2022] DELETE /identity/v3/users/5cdf3cd10df148439670673d38f764ce => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:32.925215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:32.925698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:32.925919 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:32.947299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:32.952466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:33.046869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1001/2020] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:33.059024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:33.061306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:33.134149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793370c-6bce-42fa-85be-7fc6e6206726 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:33.138426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721521b-39ee-478e-b585-4b3808125c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:33.139290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721521b-39ee-478e-b585-4b3808125c4c service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:33.139556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721521b-39ee-478e-b585-4b3808125c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:33.139868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721521b-39ee-478e-b585-4b3808125c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:33.151193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721521b-39ee-478e-b585-4b3808125c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:33.152778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721521b-39ee-478e-b585-4b3808125c4c service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:33.163650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1020/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:33.579149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:33.580595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:33.593902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d832-97d2-43d1-8f1c-da5d5f9628a9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:33.599523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:33.600449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:33.600738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:33.601042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] PATH_INFO: `/v3/projects/007759614d4f4aa3b7f1932d5f55b78a` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:33.602262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007759614d4f4aa3b7f1932d5f55b78a)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:33.610866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:33.768725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:33.770077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007759614d4f4aa3b7f1932d5f55b78a', 'request_id': 'req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:33.776485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007759614d4f4aa3b7f1932d5f55b78a', 'request_id': 'req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:33.902314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007759614d4f4aa3b7f1932d5f55b78a', 'request_id': 'req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:33.914637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] The token cache is being invalidate because project 007759614d4f4aa3b7f1932d5f55b78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:33.915174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:33.916523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-11f72cac-66d9-4ee4-b00e-6b5bcf1e8056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:33.918331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1002/2022] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:33 2022] DELETE /identity/v3/projects/007759614d4f4aa3b7f1932d5f55b78a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:33.925141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:33.926048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:33.926335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:33.946802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:33.947931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:34.014891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1021/2023] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:34.024340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.025142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.025604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.046757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:34.048009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:34.056886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1003/2024] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:34.061288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.071541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd18978-c561-44e4-b240-c4d18dc9dd8e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.076828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.077689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.078044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.078400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.079307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:34.079620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.081235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.105439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1022/2025] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:34.105537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.113396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae822c-b3c0-4a38-9864-54a65ac07b28 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.121800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.122794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.123273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.123564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.124660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.126637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.258685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1004/2026] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:34 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:34.263469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.273491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aca40-3c16-41a9-bbe7-806a1844ed32 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.311121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:34.334576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.335280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.335755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.335892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.336713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.338796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.454593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1023/2027] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:34 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:34.456566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.468948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392bc1-fcc4-46b5-bbc5-4315451c1bfb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.488100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.488100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.488100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.488100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.488480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.488480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.505313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1005/2028] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:34.509595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.519767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ad6ad-ffe7-4a50-b073-ce2df1e64fa5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.525085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33871a8-64da-4445-87ed-3f9c9b685062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.525803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33871a8-64da-4445-87ed-3f9c9b685062 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.526092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33871a8-64da-4445-87ed-3f9c9b685062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.526370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33871a8-64da-4445-87ed-3f9c9b685062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.527164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33871a8-64da-4445-87ed-3f9c9b685062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.528878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33871a8-64da-4445-87ed-3f9c9b685062 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.546487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1024/2029] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:34.546975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.557804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc589a5b-5e47-4bda-9603-bf80baf8bce1 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.562418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.563385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.563662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.563924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] PATH_INFO: `/v3/projects/cdba4272382e44bf90876cfa07db1994/users/dd9e269b9f8349ef8c11ac94e4081dce/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.578864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdba4272382e44bf90876cfa07db1994, user_id=dd9e269b9f8349ef8c11ac94e4081dce, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.581577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.654550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1006/2030] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:34 2022] PUT /identity/v3/projects/cdba4272382e44bf90876cfa07db1994/users/dd9e269b9f8349ef8c11ac94e4081dce/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:34.665291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.665636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.665921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.692759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] MFA Rules not processed for user `dd9e269b9f8349ef8c11ac94e4081dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:34.694084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:34.768109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1025/2031] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:34.826430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:34.828359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:34.899206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a01d-03a0-4c9b-85a6-9982341e70ba admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:34.903425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:34.904089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:34.904373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:34.904652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:34.913618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:34.915125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:34.929483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1007/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:38.965339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:38.970926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:38.990165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:38.992509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:39.039949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2c75-025e-41fe-8071-03a14517e4df None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:39.044962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:39.045847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:39.046123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:39.046396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] PATH_INFO: `/v3/users/21d0f4e01c0743868615bb73b622d961` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:39.047629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d0f4e01c0743868615bb73b622d961)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:39.049633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:39.068289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e664-3556-4d9d-a72f-d81df0606595 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:39.074516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:39.075469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:39.075750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:39.076031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] PATH_INFO: `/v3/users/02cd9bdf276f48418c2558a7b920f67d` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:39.077386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02cd9bdf276f48418c2558a7b920f67d)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:39.080649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:39.096591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:39.272236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d0f4e01c0743868615bb73b622d961'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.273346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:39.279649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d0f4e01c0743868615bb73b622d961'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.280313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d0f4e01c0743868615bb73b622d961'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.280918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d0f4e01c0743868615bb73b622d961'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.293333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2751260d-42e6-45f1-bcb4-0be2c3fecf85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d0f4e01c0743868615bb73b622d961'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.362444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02cd9bdf276f48418c2558a7b920f67d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.371261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02cd9bdf276f48418c2558a7b920f67d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.372244 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02cd9bdf276f48418c2558a7b920f67d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.372746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02cd9bdf276f48418c2558a7b920f67d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.384468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1026/2033] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:38 2022] DELETE /identity/v3/users/21d0f4e01c0743868615bb73b622d961 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:39.389134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6dcf-5f7d-4686-8366-06cc8d5c9a0b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:39.389318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02cd9bdf276f48418c2558a7b920f67d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:39.389457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6dcf-5f7d-4686-8366-06cc8d5c9a0b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:39.389738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6dcf-5f7d-4686-8366-06cc8d5c9a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:39.411575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6a5b6dcf-5f7d-4686-8366-06cc8d5c9a0b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:39.425751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6a5b6dcf-5f7d-4686-8366-06cc8d5c9a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:39.473897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1027/2034] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:39.484883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1008/2035] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:38 2022] DELETE /identity/v3/users/02cd9bdf276f48418c2558a7b920f67d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:39.489280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:39.489665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:39.490017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:39.493098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:39.494573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:39.509255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:39.510536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:39.556857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cb2b5-43d6-4035-82e9-f1e41c4fa109 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:39.562469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:39.563705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:39.564127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:39.564482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:39.592968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1028/2036] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:39.599794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:39.624079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b0f07-0ffe-4020-8d69-c63fd94c3ea2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:39.631571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:39.631571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:39.631571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:39.631571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:39.646122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:39.648120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:39.656316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:39.658303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:39.661124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1029/2037] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:39.670110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1009/2038] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:40.384865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:40.386481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:40.388012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:40.390431 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:40.405010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721169f8-7236-43bb-a3fa-aa54e7c46d1a service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:40.414568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630de4e-878a-4961-89cb-3f4f985b2cb5 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:40.422845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:40.424124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.425742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:40.426724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.426867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.427220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.428088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] PATH_INFO: `/v3/projects/7f96bf275668483693b201f24c5be5dd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.429159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] PATH_INFO: `/v3/projects/d939afd9c059458c9de1245a15994373` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.432075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f96bf275668483693b201f24c5be5dd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:40.432196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d939afd9c059458c9de1245a15994373)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:40.434302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:40.434429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:40.562566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:40.571479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd939afd9c059458c9de1245a15994373', 'request_id': 'req-3578bc1c-a068-45f0-9d8d-44f08449fca2'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.574490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:40.576282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f96bf275668483693b201f24c5be5dd', 'request_id': 'req-6b12d416-5093-4c0c-86bf-6e5105952c01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.578262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd939afd9c059458c9de1245a15994373', 'request_id': 'req-3578bc1c-a068-45f0-9d8d-44f08449fca2'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.583957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f96bf275668483693b201f24c5be5dd', 'request_id': 'req-6b12d416-5093-4c0c-86bf-6e5105952c01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.681463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd939afd9c059458c9de1245a15994373', 'request_id': 'req-3578bc1c-a068-45f0-9d8d-44f08449fca2'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.694541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] The token cache is being invalidate because project d939afd9c059458c9de1245a15994373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:40.694868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.695517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.697415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1010/2039] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:40 2022] DELETE /identity/v3/projects/d939afd9c059458c9de1245a15994373 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:40.701116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:40.702547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:40.771125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578bc1c-a068-45f0-9d8d-44f08449fca2 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:40.778495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f96bf275668483693b201f24c5be5dd', 'request_id': 'req-6b12d416-5093-4c0c-86bf-6e5105952c01'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.792847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] The token cache is being invalidate because project 7f96bf275668483693b201f24c5be5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:40.793147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.793821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6b12d416-5093-4c0c-86bf-6e5105952c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:40.798960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1030/2040] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:40 2022] DELETE /identity/v3/projects/7f96bf275668483693b201f24c5be5dd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:40.800920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d4ad-98ff-449c-b02e-d6c22d6ee72a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.801171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d4ad-98ff-449c-b02e-d6c22d6ee72a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.801460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d4ad-98ff-449c-b02e-d6c22d6ee72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.834549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9c07d4ad-98ff-449c-b02e-d6c22d6ee72a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:40.836428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9c07d4ad-98ff-449c-b02e-d6c22d6ee72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:40.840510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:40.841326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.841609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.841883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] PATH_INFO: `/v3/users/0b05d094312947fea1ec098326f7f45c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.843384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b05d094312947fea1ec098326f7f45c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:40.846303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:40.853609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1031/2041] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:40.855517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.855933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.856412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.880510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:40.881723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:40.890661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1032/2042] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:40.894839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:40.904655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda8b2-531c-4ef9-a3a5-a2db99cdf10e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:40.909618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:40.910283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.910566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.910841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.911618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:40.911926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:40.918968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:40.930912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1033/2043] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:40.932158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:40.942037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec561b0-7685-4217-bc26-7b5486bf3d41 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:40.947715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:40.948466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:40.949003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:40.949493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:40.950602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:40.952820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.066918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1034/2044] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:40 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:41.071371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.073487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b05d094312947fea1ec098326f7f45c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.081868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b05d094312947fea1ec098326f7f45c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.082577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b05d094312947fea1ec098326f7f45c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.083198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b05d094312947fea1ec098326f7f45c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.096553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b05d094312947fea1ec098326f7f45c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.133056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84887b67-f8fc-49ca-a824-e5c72d621802 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.138056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.138736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.139023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.139341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.140041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.142073 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.189210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1011/2045] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:40 2022] DELETE /identity/v3/users/0b05d094312947fea1ec098326f7f45c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:41.236094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1035/2046] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:41 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:41.239815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.241859 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:41.310616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307bd6-864e-43a4-9346-f7efc2e4b550 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.315281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.316002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.316288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.316566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.317303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.318980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.328795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1012/2047] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:41.332783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.343675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437bcc6-4a3f-4a73-a304-5741a38de1bf admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.348388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.349088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.349371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.349652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.351033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.352681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.364697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1036/2048] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:41.366684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.368659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:41.368780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.380083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b7c4-5dbb-4173-88fa-b7faa0d8c50f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.396231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8902ed-1e2d-4d3d-a61b-ac20496003df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.397671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8902ed-1e2d-4d3d-a61b-ac20496003df admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.397956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8902ed-1e2d-4d3d-a61b-ac20496003df admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.398232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8902ed-1e2d-4d3d-a61b-ac20496003df admin admin] PATH_INFO: `/v3/projects/ee2e2a6b6fc54320ae2dc8192ec4cc7e/users/59068f3fc6294353bb9ad2bef547be6a/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.402718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d70ad-82f6-4b3f-9dbf-780b9e290852 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.407943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.408825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.409108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.409383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] PATH_INFO: `/v3/users/aca01b6a14944e75a7ff3643003afe4e` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.410653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca01b6a14944e75a7ff3643003afe4e)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.422852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.425355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8902ed-1e2d-4d3d-a61b-ac20496003df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2e2a6b6fc54320ae2dc8192ec4cc7e, user_id=59068f3fc6294353bb9ad2bef547be6a, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.428158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8902ed-1e2d-4d3d-a61b-ac20496003df admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.543913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1037/2049] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:41 2022] PUT /identity/v3/projects/ee2e2a6b6fc54320ae2dc8192ec4cc7e/users/59068f3fc6294353bb9ad2bef547be6a/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:41.558374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.559326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.559808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.595484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:41.596148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] MFA Rules not processed for user `59068f3fc6294353bb9ad2bef547be6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:41.597400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:41.638121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca01b6a14944e75a7ff3643003afe4e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.645745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca01b6a14944e75a7ff3643003afe4e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.646494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca01b6a14944e75a7ff3643003afe4e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.647246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca01b6a14944e75a7ff3643003afe4e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.666219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1038/2050] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:41.667266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.668550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:41.670418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca01b6a14944e75a7ff3643003afe4e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.745768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a02e57-6a0e-4a4b-90b8-495e5ad186bc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.750935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.751834 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.752129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.752443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] PATH_INFO: `/v3/projects/479fbf8b697b4ca38f7273fc6c00038c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.753638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=479fbf8b697b4ca38f7273fc6c00038c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.755598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.760249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1013/2051] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:41 2022] DELETE /identity/v3/users/aca01b6a14944e75a7ff3643003afe4e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:41.760901 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:41.762259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:41.768424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:41.837866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6c477-f6ea-4aa6-bfa7-e7d182f81837 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:41.844096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cdd56-3f3d-4428-a72c-9cb3d559bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:41.844785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cdd56-3f3d-4428-a72c-9cb3d559bc30 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.845067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cdd56-3f3d-4428-a72c-9cb3d559bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.845403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cdd56-3f3d-4428-a72c-9cb3d559bc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:41.846118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cdd56-3f3d-4428-a72c-9cb3d559bc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:41.848049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cdd56-3f3d-4428-a72c-9cb3d559bc30 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:41.863915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479fbf8b697b4ca38f7273fc6c00038c', 'request_id': 'req-9a555c5e-ccc6-402f-96b2-087d806e8a2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.870970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479fbf8b697b4ca38f7273fc6c00038c', 'request_id': 'req-9a555c5e-ccc6-402f-96b2-087d806e8a2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.975927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479fbf8b697b4ca38f7273fc6c00038c', 'request_id': 'req-9a555c5e-ccc6-402f-96b2-087d806e8a2e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:41.984481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1014/2052] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:41 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:41.989241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7b5f5-de8e-4980-93b2-99337685da14 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:41.989543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7b5f5-de8e-4980-93b2-99337685da14 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:41.989830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7b5f5-de8e-4980-93b2-99337685da14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.011092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] The token cache is being invalidate because project 479fbf8b697b4ca38f7273fc6c00038c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:42.011526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:42.012893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:42.018222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1039/2053] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:41 2022] DELETE /identity/v3/projects/479fbf8b697b4ca38f7273fc6c00038c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:42.018222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.019879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7ae7b5f5-de8e-4980-93b2-99337685da14 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:42.020287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.021434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7ae7b5f5-de8e-4980-93b2-99337685da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.086838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1015/2054] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:42.088291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.088587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.089629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.112698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:42.112698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.152071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1016/2055] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:42.158669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.163212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.187360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555c5e-ccc6-402f-96b2-087d806e8a2e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.202732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.205961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.206253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.206525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.207258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.210478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.279201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5842-8aaa-4f3b-a261-3d122ef35485 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.285940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db680-d929-4d16-b90a-98ef8f170743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.288734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db680-d929-4d16-b90a-98ef8f170743 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.288734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db680-d929-4d16-b90a-98ef8f170743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.288734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db680-d929-4d16-b90a-98ef8f170743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.308351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7db680-d929-4d16-b90a-98ef8f170743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.315808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7db680-d929-4d16-b90a-98ef8f170743 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.330675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1017/2056] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:42.340009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.340456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.341055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.354106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1040/2057] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:42.364239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:42.364591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.367570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.390347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdf18e-6bcd-479d-8f22-58f0914be0aa admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.391781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1018/2058] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:42.395938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.400066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.401743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.402042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.402396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.403331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.405327 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.409601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ed075-3b2c-4a86-85b5-f0cc696fd83e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.421350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1041/2059] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:42.426546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.427467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.428150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.428621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.429088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.429885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:42.430349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.432374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.447189 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27ba7a-86ac-4ec5-aa18-796772bc1bb9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.452666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.453265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1019/2060] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:42.456741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.457047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.457335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.457632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.458087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.460539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.469219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737bf2-56c7-465c-a09c-edbca68dd10e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.473063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1042/2061] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:42.475484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.478178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.478178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.478178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.478178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.480488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.481208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.493968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ba77-afdb-411b-b3bb-c8036ea2d79f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.499824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e9cb6-5c0c-4e94-af0c-87a2929c660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.500714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e9cb6-5c0c-4e94-af0c-87a2929c660d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.501000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e9cb6-5c0c-4e94-af0c-87a2929c660d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.501295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e9cb6-5c0c-4e94-af0c-87a2929c660d admin admin] PATH_INFO: `/v3/projects/e96a78a8d78249e59be2359bb22478d0/users/a22b8f1a9ecf40158073ba478e887111/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.517162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e9cb6-5c0c-4e94-af0c-87a2929c660d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96a78a8d78249e59be2359bb22478d0, user_id=a22b8f1a9ecf40158073ba478e887111, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.519948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e9cb6-5c0c-4e94-af0c-87a2929c660d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.569368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:42.578992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1020/2062] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:42.582935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.602516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1043/2063] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:42 2022] PUT /identity/v3/projects/e96a78a8d78249e59be2359bb22478d0/users/a22b8f1a9ecf40158073ba478e887111/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:42.614759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.615127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.615578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.648105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] MFA Rules not processed for user `a22b8f1a9ecf40158073ba478e887111`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:42.649342 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.670582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8ecb-de95-48eb-a607-383556bddfd2 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.686599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:42.751389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1044/2064] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:42.753915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.766954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.767985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.768664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.768825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.769523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.775989 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.820098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4ccc2-ebe4-4d6c-a6b9-0bea65b41b39 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.824888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.825553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.825836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.826112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.826798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.829445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.884366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1021/2065] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:42.885657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.892557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:42.908614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651553-6a21-42f7-abb5-7a2981e06109 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.912009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1045/2066] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:42 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:42.913949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:42.914105 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.915004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.915312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.915658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] PATH_INFO: `/v3/projects/988f75d3d5104f008193c60e2e38faef` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.916868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988f75d3d5104f008193c60e2e38faef)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.931419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:42.964456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:42.984827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd00bc-bd73-4f41-8e82-b2c05de7feaf admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:42.990140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:42.991413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:42.991703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:42.991982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:42.992766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:42.994440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.003773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:43.008102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1046/2067] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:43.008925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.019766 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e2af-ad98-4024-bc8f-871f257d1495 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.024640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.025330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.025610 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.025884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.026586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.028807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.053680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988f75d3d5104f008193c60e2e38faef', 'request_id': 'req-f7e6c058-806f-4ea5-a07c-923b629debb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:43.060397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988f75d3d5104f008193c60e2e38faef', 'request_id': 'req-f7e6c058-806f-4ea5-a07c-923b629debb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:43.117650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1047/2068] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:43.117650 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.127105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6118c3-e02c-41c5-9e49-adbbd39f2582 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.138197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988f75d3d5104f008193c60e2e38faef', 'request_id': 'req-f7e6c058-806f-4ea5-a07c-923b629debb6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:43.152824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] The token cache is being invalidate because project 988f75d3d5104f008193c60e2e38faef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:43.153114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:43.153846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:43.158823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1022/2069] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:42 2022] DELETE /identity/v3/projects/988f75d3d5104f008193c60e2e38faef => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:43.158823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.158823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:43.208991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c069-96c5-486b-8ccd-097b5eab75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.214314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c069-96c5-486b-8ccd-097b5eab75e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.214314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c069-96c5-486b-8ccd-097b5eab75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.214314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c069-96c5-486b-8ccd-097b5eab75e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.214314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48c069-96c5-486b-8ccd-097b5eab75e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.214620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48c069-96c5-486b-8ccd-097b5eab75e9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.239488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1048/2070] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:43.241814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c058-806f-4ea5-a07c-923b629debb6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.248178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.248178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.248178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.248452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c21af-5576-41a3-9762-d55b467750b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.248452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c21af-5576-41a3-9762-d55b467750b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.248452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c21af-5576-41a3-9762-d55b467750b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.248707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c21af-5576-41a3-9762-d55b467750b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.249220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c21af-5576-41a3-9762-d55b467750b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.251037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c21af-5576-41a3-9762-d55b467750b2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.253984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:43.263008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1023/2071] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:43.264694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.264890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.265175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.269367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:43.270801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:43.285925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1049/2072] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:43.285925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.285925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:43.295321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] MFA Rules not processed for user `75b429eb57bd41baaa1a0952ca63eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:43.295741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c204-1f79-49d3-b6db-f5c137fa0c18 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.297594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:43.300812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a95cc-0494-4181-b6eb-c29b9dc0f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.301776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a95cc-0494-4181-b6eb-c29b9dc0f6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.304093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a95cc-0494-4181-b6eb-c29b9dc0f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.304093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a95cc-0494-4181-b6eb-c29b9dc0f6c8 admin admin] PATH_INFO: `/v3/projects/66a4b4b0a3ac4f4894f501beddecac52/users/f951b967507d486d93dd8a61b7d38b5c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.318150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a95cc-0494-4181-b6eb-c29b9dc0f6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a4b4b0a3ac4f4894f501beddecac52, user_id=f951b967507d486d93dd8a61b7d38b5c, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.320903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a95cc-0494-4181-b6eb-c29b9dc0f6c8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.363765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1024/2073] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:43.364580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.377275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d84cd-b293-4c4b-a7b6-fc7cc949db59 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.386215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1050/2074] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:43 2022] PUT /identity/v3/projects/66a4b4b0a3ac4f4894f501beddecac52/users/f951b967507d486d93dd8a61b7d38b5c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:43.389514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa84c1-a308-4c99-a324-42dbe1276203 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.389922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa84c1-a308-4c99-a324-42dbe1276203 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.390816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa84c1-a308-4c99-a324-42dbe1276203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.418383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4baa84c1-a308-4c99-a324-42dbe1276203 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:43.420505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4baa84c1-a308-4c99-a324-42dbe1276203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:43.460097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.461012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.461297 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.461593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] PATH_INFO: `/v3/projects/36fd17a32ecd42c1acdbc450ff3a6c55/users/d50ef1ad69614234a4f35b2a3bd0f5e9/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.491432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fd17a32ecd42c1acdbc450ff3a6c55, user_id=d50ef1ad69614234a4f35b2a3bd0f5e9, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.494985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.509520 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1051/2075] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:43.510742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.511100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.511477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.518953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:43.541719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] MFA Rules not processed for user `f951b967507d486d93dd8a61b7d38b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:43.543007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:43.577148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1025/2076] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:43 2022] PUT /identity/v3/projects/36fd17a32ecd42c1acdbc450ff3a6c55/users/d50ef1ad69614234a4f35b2a3bd0f5e9/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:43.578317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.689765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1052/2077] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:43.691274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.691848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877d49a-fd77-4d97-b7b7-2f8734e6e966 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.701527 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.702493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.702923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.703454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.703584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c363-bb7f-4fc5-b801-c388d2b43e4a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.705862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:43.706448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.708972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.710264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.710630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.711087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.711222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.711974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.713646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.735982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1026/2078] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:43.737012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.740028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1053/2079] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:43.744381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.749628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bd147-2632-41c8-bd20-59487a7180f9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.754869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.755617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.756037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.756448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.757209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.759455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.759976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29348-9da3-47da-b2f7-602995521217 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.768428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:43.769815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:43.770291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:43.771474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:43.773641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:43.775713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:43.877377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:43.897391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1027/2080] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:43.897391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.900347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1054/2081] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:43.904806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:43.992066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529e75-b0c9-4d9b-a629-427a8a57a059 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:43.999138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7382f3b-3952-471e-b2c8-4c6eef647dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.000170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7382f3b-3952-471e-b2c8-4c6eef647dff admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.013565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7382f3b-3952-471e-b2c8-4c6eef647dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.013565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7382f3b-3952-471e-b2c8-4c6eef647dff admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.013565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7382f3b-3952-471e-b2c8-4c6eef647dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.013565 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7382f3b-3952-471e-b2c8-4c6eef647dff admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.016560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189385ac-b70f-4521-b9ed-38033edb762d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.021494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.023053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.023370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.023651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] PATH_INFO: `/v3/projects/36fd17a32ecd42c1acdbc450ff3a6c55/users/d50ef1ad69614234a4f35b2a3bd0f5e9/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.025739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fd17a32ecd42c1acdbc450ff3a6c55, user_id=d50ef1ad69614234a4f35b2a3bd0f5e9, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.028484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.040398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1028/2082] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:43 2022] PUT /identity/v3/projects/36fd17a32ecd42c1acdbc450ff3a6c55/users/d50ef1ad69614234a4f35b2a3bd0f5e9/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:44.041370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.105023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1055/2083] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:43 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:44.106427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.106724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.107008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.123382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1925b-1b3c-40e8-b97c-29a4202e35ed admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.123382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.123382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.123382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.123738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.123738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.125037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.139516 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] MFA Rules not processed for user `d50ef1ad69614234a4f35b2a3bd0f5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:44.140734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:44.186986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:44.220000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1056/2084] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:44.224297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.234607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1029/2085] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:44 2022] POST /identity/v3/users => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:44.234607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.239350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:44.245479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61d60-1fc4-4de6-801e-d349bfb7fb1e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.250608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.251515 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.251903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.252575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.253556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.255482 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.268388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1057/2086] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:44.269402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.283731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685bf79-107f-45f3-bac5-30db79ac148e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.291350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.292190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.292652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.293078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.294085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.296413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.308547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1058/2087] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:44.309274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.320226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb504b-14c3-43a4-9c05-1b2f9e971c60 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.325172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.326069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.326353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.328285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] PATH_INFO: `/v3/projects/9416922d0be64d129b51421bb5df7e5f/users/0f6dc97c41de4f5a917db751b28c1db4/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.329031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b40bcb-3768-4336-b753-8acbd7ceaa3b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.333881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.335084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.335453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.335727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.338076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:44.344068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9416922d0be64d129b51421bb5df7e5f, user_id=0f6dc97c41de4f5a917db751b28c1db4, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.346785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.383936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:44.411512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.413586 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.422461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1030/2088] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:44.423252 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.433212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75651ab-043c-44b3-8eec-1a5733bca9be service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.437964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.438613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.438890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.439161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.439933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.441471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.446477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1059/2089] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:44 2022] PUT /identity/v3/projects/9416922d0be64d129b51421bb5df7e5f/users/0f6dc97c41de4f5a917db751b28c1db4/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:44.451001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.451942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1031/2090] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:44.456160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.466065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0bbeb-25bb-49ea-a7f1-0b0d88b62027 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.539659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44902f03-00c6-4d59-b010-082dbf959e09 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.545230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.546123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.546527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.547077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.548032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.549746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.563135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1060/2091] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:44.567115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.573332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c057134-a87a-4e4a-8c2d-ddd75e431420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.574973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057134-a87a-4e4a-8c2d-ddd75e431420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.575326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057134-a87a-4e4a-8c2d-ddd75e431420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.575980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057134-a87a-4e4a-8c2d-ddd75e431420 admin admin] PATH_INFO: `/v3/projects/82bcab5f29dd48ef8a21cd9adc357f48/users/348a871ce2964acfbf742e29f6675513/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.577754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95039c04-f74e-4e6c-aca9-5ad91f98ef9d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.584361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37e63-bb03-4f8b-a6b1-edc25fd4b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.585738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37e63-bb03-4f8b-a6b1-edc25fd4b520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.586062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37e63-bb03-4f8b-a6b1-edc25fd4b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.586350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37e63-bb03-4f8b-a6b1-edc25fd4b520 admin admin] PATH_INFO: `/v3/projects/9416922d0be64d129b51421bb5df7e5f/users/0f6dc97c41de4f5a917db751b28c1db4/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.588780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37e63-bb03-4f8b-a6b1-edc25fd4b520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9416922d0be64d129b51421bb5df7e5f, user_id=0f6dc97c41de4f5a917db751b28c1db4, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.591657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37e63-bb03-4f8b-a6b1-edc25fd4b520 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.592444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c057134-a87a-4e4a-8c2d-ddd75e431420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bcab5f29dd48ef8a21cd9adc357f48, user_id=348a871ce2964acfbf742e29f6675513, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.596417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c057134-a87a-4e4a-8c2d-ddd75e431420 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.605267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1061/2092] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:44 2022] PUT /identity/v3/projects/9416922d0be64d129b51421bb5df7e5f/users/0f6dc97c41de4f5a917db751b28c1db4/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:44.617228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.617528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.617832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.647697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] MFA Rules not processed for user `0f6dc97c41de4f5a917db751b28c1db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:44.648899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:44.715909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:44.721736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1062/2093] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:44.728643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1032/2094] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:44 2022] PUT /identity/v3/projects/82bcab5f29dd48ef8a21cd9adc357f48/users/348a871ce2964acfbf742e29f6675513/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:44.733627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.735082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:44.745137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.745784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.745784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.782130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] MFA Rules not processed for user `348a871ce2964acfbf742e29f6675513`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:44.783442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:44.803874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f701955-cc4d-499d-8909-fc2ae364c6f5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.862127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1033/2095] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:44.866483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:44.875936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.876598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.876899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.877160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.932064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e519b2-0b0c-42e3-9d00-73a411975760 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:44.937045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:44.937804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:44.938154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:44.938882 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:44.939526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.941267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.954596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:44.960718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:44.960718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:44.967985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1063/2096] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:45.072610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1034/2097] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:44 2022] POST /identity/v3/projects => generated 403 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:45.076093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:45.086883 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5031-15f6-4aef-a506-748a03640861 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:45.151938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:45.155923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.155923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.155923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.155923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:45.155923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:45.282530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1064/2098] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:45 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:45.286393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:45.298221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554a11-eebc-4ea7-b12f-d4c0e300c201 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:45.304168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:45.305213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.305686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.306151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.307143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:45.309161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:45.321952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:45.324024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1035/2099] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:45.325200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:45.335797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24653ca8-a074-4824-ba2d-fd4a126ac7fc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:45.340899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:45.341857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.342150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.342469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] PATH_INFO: `/v3/projects/f7cb658b45ba478cb76485c0aa744c35/users/237d3ef77fba44708576be01245e47ad/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.367041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cb658b45ba478cb76485c0aa744c35, user_id=237d3ef77fba44708576be01245e47ad, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:45.373313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:45.464268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1065/2100] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:45 2022] PUT /identity/v3/projects/f7cb658b45ba478cb76485c0aa744c35/users/237d3ef77fba44708576be01245e47ad/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:45.468191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:45.478904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d01ea-96dd-4da3-89f8-f86e2b5eba2b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:45.535291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd318-44d1-4593-bd4f-de9f84b54dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:45.535962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd318-44d1-4593-bd4f-de9f84b54dab admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.536442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd318-44d1-4593-bd4f-de9f84b54dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.536720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd318-44d1-4593-bd4f-de9f84b54dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.537961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cd318-44d1-4593-bd4f-de9f84b54dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:45.539677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cd318-44d1-4593-bd4f-de9f84b54dab admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:45.556531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1036/2101] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:45.557809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:45.570778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca57e8-0bb1-4a59-a973-4d158d1d3886 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:45.577997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:45.577997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.578298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.578502 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] PATH_INFO: `/v3/projects/f7cb658b45ba478cb76485c0aa744c35/users/237d3ef77fba44708576be01245e47ad/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.587033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cb658b45ba478cb76485c0aa744c35, user_id=237d3ef77fba44708576be01245e47ad, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:45.590120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:45.602977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1066/2102] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:45 2022] PUT /identity/v3/projects/f7cb658b45ba478cb76485c0aa744c35/users/237d3ef77fba44708576be01245e47ad/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:45.613788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.614089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.614372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.641416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] MFA Rules not processed for user `237d3ef77fba44708576be01245e47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:45.642621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:45.719932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1037/2103] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:45.787249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:45.847598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb5766-edb3-4ea9-9bd1-72bfb4cfa961 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:45.854888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:45.856008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:45.856313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:45.856577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:45.872791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:45.872791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:45.881126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1067/2104] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:46.090791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:46.126533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:46.127933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:46.157231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d817f-37d3-4a9d-9fd9-abdd94df2811 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:46.161982 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:46.163533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.163745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.164020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] PATH_INFO: `/v3/users/348a871ce2964acfbf742e29f6675513` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.165470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] RBAC: Authorizing `identity:delete_user(user_id=348a871ce2964acfbf742e29f6675513)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:46.167164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:46.196774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1f4dd-6959-4eb7-a397-358f4adb8af4 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:46.201659 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:46.202555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.202840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.203120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] PATH_INFO: `/v3/users/f951b967507d486d93dd8a61b7d38b5c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.204471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f951b967507d486d93dd8a61b7d38b5c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:46.206403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:46.419926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f951b967507d486d93dd8a61b7d38b5c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.431288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348a871ce2964acfbf742e29f6675513'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.433256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348a871ce2964acfbf742e29f6675513'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.434707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348a871ce2964acfbf742e29f6675513'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.435484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348a871ce2964acfbf742e29f6675513'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.440686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f951b967507d486d93dd8a61b7d38b5c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.441638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f951b967507d486d93dd8a61b7d38b5c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.442769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f951b967507d486d93dd8a61b7d38b5c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.448089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:46.461439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f951b967507d486d93dd8a61b7d38b5c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.465896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-59ea351e-4276-454a-b062-13145018eaec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348a871ce2964acfbf742e29f6675513'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:46.537820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1068/2105] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:46 2022] DELETE /identity/v3/users/f951b967507d486d93dd8a61b7d38b5c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:46.538819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:46.540167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:46.598020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562b24-b2bc-46b7-9bc3-31c834290f30 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:46.602250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:46.602917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.603202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.603509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.606335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:46.612278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1038/2106] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:46 2022] DELETE /identity/v3/users/348a871ce2964acfbf742e29f6675513 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:46.618020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.618020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.618020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.635127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:46.636371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:46.666803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:46.668284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251a4cf-32f6-46f5-9d2c-567ba674a0e9 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:46.677958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1069/2107] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:46.679662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.680082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.680374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.701987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1039/2108] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:46.708264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:46.710004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:46.717975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:46.718151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1070/2109] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:46.720256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:46.738493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:46.740404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:46.815832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020991c-5c8d-4652-9618-ec3752c75bce None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:46.824352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b90d1-a571-4217-9dae-fad36be4f17c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:46.829502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:46.830181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.830467 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.830573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:46.830744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.831216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:46.831590 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:46.831927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:46.839663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:46.842913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:46.844505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:46.844622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:46.847513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:46.856008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1040/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:46.859549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1071/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:47.470666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:47.472542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:47.489132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cc2b4-59a6-44ae-9a37-dc149818c6cf service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:47.493906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:47.494937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:47.495348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:47.495741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] PATH_INFO: `/v3/projects/66a4b4b0a3ac4f4894f501beddecac52` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:47.497140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a4b4b0a3ac4f4894f501beddecac52)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:47.513577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:47.638107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a4b4b0a3ac4f4894f501beddecac52', 'request_id': 'req-d349ca46-c740-42e0-993c-5606190cd10c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.643051 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:47.644988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a4b4b0a3ac4f4894f501beddecac52', 'request_id': 'req-d349ca46-c740-42e0-993c-5606190cd10c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.645544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:47.663326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c334ff-e3f6-4ee6-866d-7d15a1df476e service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:47.693775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:47.726055 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:47.726932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:47.727227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:47.727538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] PATH_INFO: `/v3/projects/82bcab5f29dd48ef8a21cd9adc357f48` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:47.728774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bcab5f29dd48ef8a21cd9adc357f48)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:47.730695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:47.765095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a4b4b0a3ac4f4894f501beddecac52', 'request_id': 'req-d349ca46-c740-42e0-993c-5606190cd10c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.780424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] The token cache is being invalidate because project 66a4b4b0a3ac4f4894f501beddecac52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:47.780943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.781651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.783801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1041/2112] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:47 2022] DELETE /identity/v3/projects/66a4b4b0a3ac4f4894f501beddecac52 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:47.788691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:47.790057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:47.802625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349ca46-c740-42e0-993c-5606190cd10c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:47.808147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:47.809039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:47.809322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:47.809598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] PATH_INFO: `/v3/users/0f6dc97c41de4f5a917db751b28c1db4` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:47.810889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6dc97c41de4f5a917db751b28c1db4)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:47.812869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:47.862365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bcab5f29dd48ef8a21cd9adc357f48', 'request_id': 'req-416af107-8569-4bb1-bee6-e5fc6ea4afd9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.869207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bcab5f29dd48ef8a21cd9adc357f48', 'request_id': 'req-416af107-8569-4bb1-bee6-e5fc6ea4afd9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.966728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bcab5f29dd48ef8a21cd9adc357f48', 'request_id': 'req-416af107-8569-4bb1-bee6-e5fc6ea4afd9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.978282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] The token cache is being invalidate because project 82bcab5f29dd48ef8a21cd9adc357f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:47.978572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.979274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:47.980855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1072/2113] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:47 2022] DELETE /identity/v3/projects/82bcab5f29dd48ef8a21cd9adc357f48 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:47.984787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:47.986166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.048309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416af107-8569-4bb1-bee6-e5fc6ea4afd9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:48.052979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:48.053849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:48.054128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:48.054401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] PATH_INFO: `/v3/users/237d3ef77fba44708576be01245e47ad` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:48.055607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=237d3ef77fba44708576be01245e47ad)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:48.057707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:48.113401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6dc97c41de4f5a917db751b28c1db4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.120769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6dc97c41de4f5a917db751b28c1db4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.121462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6dc97c41de4f5a917db751b28c1db4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.122068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6dc97c41de4f5a917db751b28c1db4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.134534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6dc97c41de4f5a917db751b28c1db4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.225845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1042/2114] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:47 2022] DELETE /identity/v3/users/0f6dc97c41de4f5a917db751b28c1db4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:48.249625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:48.251226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.284024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237d3ef77fba44708576be01245e47ad'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.311041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237d3ef77fba44708576be01245e47ad'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.313422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237d3ef77fba44708576be01245e47ad'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.314275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237d3ef77fba44708576be01245e47ad'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.344978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237d3ef77fba44708576be01245e47ad'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.363493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:48.374317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fde36-2c27-49d5-a285-bfdb75c1d4eb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:48.379354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:48.380981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:48.380981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:48.381307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] PATH_INFO: `/v3/users/dd9e269b9f8349ef8c11ac94e4081dce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:48.382492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9e269b9f8349ef8c11ac94e4081dce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:48.384473 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:48.493491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1073/2115] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:47 2022] DELETE /identity/v3/users/237d3ef77fba44708576be01245e47ad => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:48.494746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:48.498695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.567513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb4ef-3561-4e57-8df5-f5fa7bd7a20f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:48.572459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:48.573501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:48.573793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:48.574071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:48.575939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.592062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9e269b9f8349ef8c11ac94e4081dce'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.600434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9e269b9f8349ef8c11ac94e4081dce'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.601170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9e269b9f8349ef8c11ac94e4081dce'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.601980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9e269b9f8349ef8c11ac94e4081dce'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.637047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9e269b9f8349ef8c11ac94e4081dce'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:48.658607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:48.660745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5891e6-3a75-4c4a-8c47-1eb002fefa71 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:48.672833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1074/2116] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:48.762274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1043/2117] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:48 2022] DELETE /identity/v3/users/dd9e269b9f8349ef8c11ac94e4081dce => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:48.768959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:48.769592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:48.770212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:48.801719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:48.803977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.876358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1075/2118] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:48.891111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:48.892777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.969043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad4266-21c3-459b-8f7b-40adab3cba98 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:48.974653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:48.977222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:48.977222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:48.977222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:48.978399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:48.980161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:48.989409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:48.992301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.001074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a797-bc19-4e08-9ff0-8a1ba38b4145 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.008421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.009488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.009886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.010308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] PATH_INFO: `/v3/projects/9416922d0be64d129b51421bb5df7e5f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.012258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9416922d0be64d129b51421bb5df7e5f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.014789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.015332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1044/2119] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:49.086605 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:49.098514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.100722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:49.118266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e545e-ac73-4a44-9205-9b32b87cbc29 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.124787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.124787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.125192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.125533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] PATH_INFO: `/v3/projects/f7cb658b45ba478cb76485c0aa744c35` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.126782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cb658b45ba478cb76485c0aa744c35)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.128880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.180252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9416922d0be64d129b51421bb5df7e5f', 'request_id': 'req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.188238 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9416922d0be64d129b51421bb5df7e5f', 'request_id': 'req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.263726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cb658b45ba478cb76485c0aa744c35', 'request_id': 'req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.269769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cb658b45ba478cb76485c0aa744c35', 'request_id': 'req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.280465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9416922d0be64d129b51421bb5df7e5f', 'request_id': 'req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.292171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] The token cache is being invalidate because project 9416922d0be64d129b51421bb5df7e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:49.292171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.292855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-413fe90d-d1e1-43ff-8c1d-f2d2060466b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.294422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1076/2120] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:48 2022] DELETE /identity/v3/projects/9416922d0be64d129b51421bb5df7e5f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:49.299682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b392d-abd2-42a1-a903-3e4d187001b4 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.299974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b392d-abd2-42a1-a903-3e4d187001b4 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.300700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b392d-abd2-42a1-a903-3e4d187001b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.319730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c15b392d-abd2-42a1-a903-3e4d187001b4 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:49.321021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c15b392d-abd2-42a1-a903-3e4d187001b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:49.373083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cb658b45ba478cb76485c0aa744c35', 'request_id': 'req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.391941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] The token cache is being invalidate because project f7cb658b45ba478cb76485c0aa744c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:49.393699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.395157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4a8bd93e-0eb5-4d6c-b009-b17f1abface6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:49.398285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1045/2121] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:49 2022] DELETE /identity/v3/projects/f7cb658b45ba478cb76485c0aa744c35 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:49.402895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e493ea-5911-44ae-810f-c4d02e4d879a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.403347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e493ea-5911-44ae-810f-c4d02e4d879a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.403775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e493ea-5911-44ae-810f-c4d02e4d879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.406323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1077/2122] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:49.415888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.416179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.416828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.435202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c5e493ea-5911-44ae-810f-c4d02e4d879a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:49.436476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c5e493ea-5911-44ae-810f-c4d02e4d879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:49.460905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1046/2123] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:49.461885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:49.463475 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:49.473027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.473583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.477438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1078/2124] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:49.477564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.479042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.490005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5b04-154d-42cc-bc35-a61ec911cf57 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.495649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.496334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.496623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.499737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.499880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:49.499980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:49.499980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.500152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:49.500239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.513142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1079/2125] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:49.517210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.525430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1047/2126] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:49.530861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01ac2-6427-4690-8b6d-a9233ce01b6d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.531338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.535762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.536416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.536874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.537783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.538483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.540655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.541658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab500a5-7cbb-4773-9d0e-646c6766568b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.546523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.547192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.547517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.547801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.548536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:49.548849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.550456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.563271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1048/2127] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:49.577131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.589866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55872fd7-6556-4953-9ebe-d79c7734d800 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.595047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.595947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.596242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.597364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.597364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.599416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.717005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1080/2128] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:49.721261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.770975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1049/2129] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:49.774002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.775980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:49.789700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528bbeb-754a-4b01-bdb5-49183d981db4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.842048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832f72-a01a-4e98-8d18-bef8ab438f6d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:49.846830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.847724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.848007 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.848286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] PATH_INFO: `/v3/projects/cdba4272382e44bf90876cfa07db1994` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.848671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:49.849399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:49.850175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdba4272382e44bf90876cfa07db1994)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.850272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:49.850489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:49.851177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:49.852087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.853272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:49.976113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1081/2130] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:49.976113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:49.994288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a17db7-e3f2-4ee7-92e9-a7ec8046c8ee admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.000731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:50.011079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.011897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.012184 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.012717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.013412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.015364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.034607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdba4272382e44bf90876cfa07db1994', 'request_id': 'req-1e17bbf6-495a-4ca0-9846-a72deaced296'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:50.043178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdba4272382e44bf90876cfa07db1994', 'request_id': 'req-1e17bbf6-495a-4ca0-9846-a72deaced296'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:50.110024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdba4272382e44bf90876cfa07db1994', 'request_id': 'req-1e17bbf6-495a-4ca0-9846-a72deaced296'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:50.126899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] The token cache is being invalidate because project cdba4272382e44bf90876cfa07db1994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:50.127118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1082/2131] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:49 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:50.127212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:50.127327 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.127416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:50.127503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:50.128538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1050/2132] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:49 2022] DELETE /identity/v3/projects/cdba4272382e44bf90876cfa07db1994 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:50.129731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.131913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:50.144681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050dfbb-049f-4208-a434-b49846565b18 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.226083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.227066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.227467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.227821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.229301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.231517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.247416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1083/2133] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:50.251616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.257054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17bbf6-495a-4ca0-9846-a72deaced296 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.269405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.270181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.270618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.270938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.272407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27171a5b-e862-49b7-8e43-5567b15bc5fe admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.272549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.275112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.278557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.279908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.280398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.285850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.285850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.285850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.291745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1051/2134] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:50.295563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.297986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1084/2135] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:50.307983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.311808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c375b7-829e-4751-9595-c51b917f9567 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.319504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.319874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.324119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.324119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.324119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.324401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa774478-2d24-4042-bcb2-65e6cba38f1c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.324493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.329048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f9e17-f549-409e-8b16-66c4040a5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.331913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f9e17-f549-409e-8b16-66c4040a5c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.331913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f9e17-f549-409e-8b16-66c4040a5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.331913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f9e17-f549-409e-8b16-66c4040a5c9a admin admin] PATH_INFO: `/v3/projects/3f4bd9910c424c57ad0de87b462b5b53/users/eceffb872a4f48fa94f7df916625ad54/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.337187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1052/2136] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:50.341378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.351109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f9e17-f549-409e-8b16-66c4040a5c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4bd9910c424c57ad0de87b462b5b53, user_id=eceffb872a4f48fa94f7df916625ad54, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.352185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6cbd-16ef-45ad-81c2-edfeb66990fb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.354269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f9e17-f549-409e-8b16-66c4040a5c9a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.356958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e40ad-76ae-4ce5-9f26-8b494189c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.357851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e40ad-76ae-4ce5-9f26-8b494189c7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.358136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e40ad-76ae-4ce5-9f26-8b494189c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.358410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e40ad-76ae-4ce5-9f26-8b494189c7f9 admin admin] PATH_INFO: `/v3/projects/09ed20fd3f7747dba5290d7111d20d08/users/a8bf3313b24a409c8c6e91ad7485c8a9/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.373395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e40ad-76ae-4ce5-9f26-8b494189c7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ed20fd3f7747dba5290d7111d20d08, user_id=a8bf3313b24a409c8c6e91ad7485c8a9, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.376202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e40ad-76ae-4ce5-9f26-8b494189c7f9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.406091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1085/2137] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:50 2022] PUT /identity/v3/projects/3f4bd9910c424c57ad0de87b462b5b53/users/eceffb872a4f48fa94f7df916625ad54/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:50.417760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.418047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.418327 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.424895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1053/2138] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:50 2022] PUT /identity/v3/projects/09ed20fd3f7747dba5290d7111d20d08/users/a8bf3313b24a409c8c6e91ad7485c8a9/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:50.439765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.441084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.441084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.452351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] MFA Rules not processed for user `eceffb872a4f48fa94f7df916625ad54`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:50.453750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:50.471939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] MFA Rules not processed for user `a8bf3313b24a409c8c6e91ad7485c8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:50.473178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:50.531584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1086/2139] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:50.535903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.542719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1054/2140] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:50.546926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.613153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c72d3-3f83-4a0f-bd86-bbd8b8066da4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.617711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc701e7-d1e1-4065-9811-1ada210d66a7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.617963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.618670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.618897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.619163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.619902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.621881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.623840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.624722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.625194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.625863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.626691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.629010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.710081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:50.749934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1055/2141] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:50 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:50.754030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.774853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1087/2142] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:50 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:50.778876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.827380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506bb81-02a6-4918-b82a-d84c073e5acf admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.842788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9af4e5-1f04-4da7-ad59-2cdfc9b7beb0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.850570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.851382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.851656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.852003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.852698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.854668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.886938 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.887900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.888182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.888456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.889139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.891114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.938409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1088/2143] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:50 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:50.942082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.952047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20433cf-94ed-45ca-899a-d614aca52484 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.956713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.957349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.957633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.957937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.958646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:50.960913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:50.970744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1089/2144] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:50.975507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.979020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1056/2145] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:50 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:50.984554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:50.985212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6bec7-9a90-4bed-99fc-f321d0c5ae5e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:50.989856 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:50.991425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:50.991692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:50.991972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] PATH_INFO: `/v3/projects/d29eb0129f5a4ad18faf2f35777e325f/users/16e69d3204a5412a8f9720125a317a0f/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:50.995340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3293b-27af-4196-8c5a-64c416e5a1be admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.000080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.000732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.001021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.001296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.002049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.003741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.007490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29eb0129f5a4ad18faf2f35777e325f, user_id=16e69d3204a5412a8f9720125a317a0f, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.010132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.014212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1057/2146] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:51.018215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.028380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47778198-f005-45be-b5f5-9218c8b16683 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.033004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.033885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.034207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.039457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] PATH_INFO: `/v3/projects/b918f34b28b54e76b349b4e9addd1591/users/97736e01ea8544b6a6ac8e57552bf812/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.051741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b918f34b28b54e76b349b4e9addd1591, user_id=97736e01ea8544b6a6ac8e57552bf812, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.054411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.087291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1090/2147] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:50 2022] PUT /identity/v3/projects/d29eb0129f5a4ad18faf2f35777e325f/users/16e69d3204a5412a8f9720125a317a0f/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:51.091337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.132663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1058/2148] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:51 2022] PUT /identity/v3/projects/b918f34b28b54e76b349b4e9addd1591/users/97736e01ea8544b6a6ac8e57552bf812/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:51.136568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.152507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04223c8-96bc-42a6-bea6-4df7e24d3364 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.197629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a1d5-1d73-4388-85e7-e9428958653f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.202440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.203098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.203417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.203695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.204451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.207519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.211786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.211786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.211786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.211786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.212139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.212759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.217340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1059/2149] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:51.221218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.222862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1091/2150] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:51.227786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.233743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0d669-9de7-49fd-96f0-9746d718de5c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.238689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217f40-11c2-49cf-919b-417b585a8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.239270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28231529-efc0-4dd2-aed2-b34bc1b07645 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.239636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217f40-11c2-49cf-919b-417b585a8021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.239922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217f40-11c2-49cf-919b-417b585a8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.240230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217f40-11c2-49cf-919b-417b585a8021 admin admin] PATH_INFO: `/v3/projects/b918f34b28b54e76b349b4e9addd1591/users/97736e01ea8544b6a6ac8e57552bf812/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.242218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89217f40-11c2-49cf-919b-417b585a8021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b918f34b28b54e76b349b4e9addd1591, user_id=97736e01ea8544b6a6ac8e57552bf812, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.244106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7125e1-7506-46f5-8804-0ecd2ee023e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.244957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89217f40-11c2-49cf-919b-417b585a8021 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.245069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7125e1-7506-46f5-8804-0ecd2ee023e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.245351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7125e1-7506-46f5-8804-0ecd2ee023e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.245663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7125e1-7506-46f5-8804-0ecd2ee023e9 admin admin] PATH_INFO: `/v3/projects/d29eb0129f5a4ad18faf2f35777e325f/users/16e69d3204a5412a8f9720125a317a0f/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.247774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7125e1-7506-46f5-8804-0ecd2ee023e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29eb0129f5a4ad18faf2f35777e325f, user_id=16e69d3204a5412a8f9720125a317a0f, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.250401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7125e1-7506-46f5-8804-0ecd2ee023e9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.261398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1092/2152] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:51 2022] PUT /identity/v3/projects/d29eb0129f5a4ad18faf2f35777e325f/users/16e69d3204a5412a8f9720125a317a0f/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:51.263339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1060/2152] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:51 2022] PUT /identity/v3/projects/b918f34b28b54e76b349b4e9addd1591/users/97736e01ea8544b6a6ac8e57552bf812/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:51.269567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.269860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.271892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.273461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba936e-913e-4310-8699-868de57b892e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.273819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba936e-913e-4310-8699-868de57b892e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.274102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba936e-913e-4310-8699-868de57b892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.303615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-55ba936e-913e-4310-8699-868de57b892e None None] MFA Rules not processed for user `16e69d3204a5412a8f9720125a317a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:51.303833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] MFA Rules not processed for user `97736e01ea8544b6a6ac8e57552bf812`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:51.304706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:51.304818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-55ba936e-913e-4310-8699-868de57b892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:51.400582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1061/2153] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:51.406458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba936e-913e-4310-8699-868de57b892e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.406620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1093/2154] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:51.408257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-55ba936e-913e-4310-8699-868de57b892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:51.418795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.422705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:51.470158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba936e-913e-4310-8699-868de57b892e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.473925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.474604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.474900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.475163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.484624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecc867-2585-4978-abe8-85afbe35bc4e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.485543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.487165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.489026 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.489727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.490010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.490309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.499073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1062/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:51.501454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.503050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.522160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1094/2156] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:51.561694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:51.632207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.647004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:51.650622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45196b-9680-491a-b2a1-ffed454e48bc service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.655021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.655972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0bce-bc1a-4042-9135-40ec8c9b7fbf service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:51.656211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.656700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.657282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.660376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e294c-214d-4ac5-9ee6-d0b191b5cc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:51.661335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e294c-214d-4ac5-9ee6-d0b191b5cc52 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:51.661787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e294c-214d-4ac5-9ee6-d0b191b5cc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:51.662582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e294c-214d-4ac5-9ee6-d0b191b5cc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:51.729474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.729959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e294c-214d-4ac5-9ee6-d0b191b5cc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:51.731003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.731448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e294c-214d-4ac5-9ee6-d0b191b5cc52 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:51.740930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1063/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:51.743028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1095/2158] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:52.167008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:52.736330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:53.407879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:53.538466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:54.029258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:54.186801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:54.188324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:54.217155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:54.253218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b2803-dc3b-4534-b1e2-8cd7073c465e service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:54.258444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:54.259349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:54.259628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:54.259904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] PATH_INFO: `/v3/users/59068f3fc6294353bb9ad2bef547be6a` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:54.261114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] RBAC: Authorizing `identity:delete_user(user_id=59068f3fc6294353bb9ad2bef547be6a)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:54.263331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:54.462984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59068f3fc6294353bb9ad2bef547be6a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:54.470141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59068f3fc6294353bb9ad2bef547be6a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:54.470778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59068f3fc6294353bb9ad2bef547be6a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:54.471500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59068f3fc6294353bb9ad2bef547be6a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:54.484369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59068f3fc6294353bb9ad2bef547be6a'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:54.502929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:54.581910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1064/2159] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:54 2022] DELETE /identity/v3/users/59068f3fc6294353bb9ad2bef547be6a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:54.586348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:54.586645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:54.586929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:54.605532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:54.606769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:54.668581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1096/2160] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:54.678165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:54.679710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:54.743998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dc65e-ee7a-4d9a-94ac-6818ad5587db admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:54.747588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d013d-1a5f-4fe5-96e1-0a96b8bc9c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:54.748263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d013d-1a5f-4fe5-96e1-0a96b8bc9c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:54.748544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d013d-1a5f-4fe5-96e1-0a96b8bc9c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:54.748818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d013d-1a5f-4fe5-96e1-0a96b8bc9c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:54.758547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d013d-1a5f-4fe5-96e1-0a96b8bc9c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:54.760183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d013d-1a5f-4fe5-96e1-0a96b8bc9c40 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:54.770967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1065/2161] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:54.952075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:54.953594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:54.965374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bf61-a7eb-4d8b-bddc-1d927a7a74e9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:54.971807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:54.972998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:54.973450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:54.973935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] PATH_INFO: `/v3/users/a8bf3313b24a409c8c6e91ad7485c8a9` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:54.978422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bf3313b24a409c8c6e91ad7485c8a9)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:54.978422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:55.223678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bf3313b24a409c8c6e91ad7485c8a9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.231536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bf3313b24a409c8c6e91ad7485c8a9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.232237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bf3313b24a409c8c6e91ad7485c8a9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.232845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bf3313b24a409c8c6e91ad7485c8a9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.245085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bf3313b24a409c8c6e91ad7485c8a9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.321276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1097/2162] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:54 2022] DELETE /identity/v3/users/a8bf3313b24a409c8c6e91ad7485c8a9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:55.325975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:55.326487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:55.326569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:55.347780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:55.349057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:55.397427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:55.416513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1066/2163] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:55.426172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:55.428436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:55.490810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f820cf1-36b1-4642-944a-0a1cfa6e9669 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:55.494936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:55.495752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:55.496131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:55.496427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:55.523050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:55.532582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:55.533637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:55.544955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1098/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:12:55.587167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:55.588641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:55.602734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cbbd7-c05c-4a02-9f8b-21771da194bd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:55.609366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:55.610556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:55.611021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:55.611650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] PATH_INFO: `/v3/projects/ee2e2a6b6fc54320ae2dc8192ec4cc7e` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:55.613352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2e2a6b6fc54320ae2dc8192ec4cc7e)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:55.615771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:55.750568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2e2a6b6fc54320ae2dc8192ec4cc7e', 'request_id': 'req-33c389ea-feba-48c6-97f2-48869929a35b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.761785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2e2a6b6fc54320ae2dc8192ec4cc7e', 'request_id': 'req-33c389ea-feba-48c6-97f2-48869929a35b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.868058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2e2a6b6fc54320ae2dc8192ec4cc7e', 'request_id': 'req-33c389ea-feba-48c6-97f2-48869929a35b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.886842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] The token cache is being invalidate because project ee2e2a6b6fc54320ae2dc8192ec4cc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:55.887217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.888299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:55.890606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1067/2165] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:55 2022] DELETE /identity/v3/projects/ee2e2a6b6fc54320ae2dc8192ec4cc7e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:55.894683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:55.905622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83894-8d77-49c9-b7a7-a696b5cc16a3 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:56.002370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:56.003267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:56.003587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:56.003843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] PATH_INFO: `/v3/users/a22b8f1a9ecf40158073ba478e887111` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:56.005045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22b8f1a9ecf40158073ba478e887111)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:56.019144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:56.156573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:56.158136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:56.182186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c389ea-feba-48c6-97f2-48869929a35b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:56.187905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:56.189029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:56.189373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:56.189694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] PATH_INFO: `/v3/projects/09ed20fd3f7747dba5290d7111d20d08` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:56.191143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ed20fd3f7747dba5290d7111d20d08)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:56.193785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:56.215483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22b8f1a9ecf40158073ba478e887111'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.223397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22b8f1a9ecf40158073ba478e887111'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.224122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22b8f1a9ecf40158073ba478e887111'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.225921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22b8f1a9ecf40158073ba478e887111'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.240593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22b8f1a9ecf40158073ba478e887111'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.313443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ed20fd3f7747dba5290d7111d20d08', 'request_id': 'req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.321242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1099/2166] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:55 2022] DELETE /identity/v3/users/a22b8f1a9ecf40158073ba478e887111 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:56.325301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ed20fd3f7747dba5290d7111d20d08', 'request_id': 'req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.469403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ed20fd3f7747dba5290d7111d20d08', 'request_id': 'req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.481822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] The token cache is being invalidate because project 09ed20fd3f7747dba5290d7111d20d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:56.482111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.482766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.484587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1068/2167] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:56 2022] DELETE /identity/v3/projects/09ed20fd3f7747dba5290d7111d20d08 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:56.488250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:56.489784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:56.571346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d4ede-fd7a-4a96-80e5-e34d8b82b776 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:56.577066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:56.577996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:56.578279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:56.578558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] PATH_INFO: `/v3/users/97736e01ea8544b6a6ac8e57552bf812` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:56.580311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97736e01ea8544b6a6ac8e57552bf812)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:56.582335 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:56.765576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97736e01ea8544b6a6ac8e57552bf812'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.773363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97736e01ea8544b6a6ac8e57552bf812'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.774200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97736e01ea8544b6a6ac8e57552bf812'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.775008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97736e01ea8544b6a6ac8e57552bf812'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.788399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97736e01ea8544b6a6ac8e57552bf812'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:56.817936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:56.819522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:56.904614 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1100/2168] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:56 2022] DELETE /identity/v3/users/97736e01ea8544b6a6ac8e57552bf812 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:56.922427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5bbc-07a3-4441-ad6c-93e4bf11ecef admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.001601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.004557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.004557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.004557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] PATH_INFO: `/v3/projects/e96a78a8d78249e59be2359bb22478d0` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.004557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96a78a8d78249e59be2359bb22478d0)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.006836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.052463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:57.083505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:57.085411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.098507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35565507-aedd-46a7-80bd-d166ed817a82 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.103867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.104733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.105018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.105296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] PATH_INFO: `/v3/users/eceffb872a4f48fa94f7df916625ad54` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.106472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=eceffb872a4f48fa94f7df916625ad54)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.108503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.175179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96a78a8d78249e59be2359bb22478d0', 'request_id': 'req-0b39fd82-1076-46d2-a435-b58cb4ac9579'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.182150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96a78a8d78249e59be2359bb22478d0', 'request_id': 'req-0b39fd82-1076-46d2-a435-b58cb4ac9579'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.259633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96a78a8d78249e59be2359bb22478d0', 'request_id': 'req-0b39fd82-1076-46d2-a435-b58cb4ac9579'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.273686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] The token cache is being invalidate because project e96a78a8d78249e59be2359bb22478d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:57.273985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.274735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.279256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1069/2169] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:56 2022] DELETE /identity/v3/projects/e96a78a8d78249e59be2359bb22478d0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:57.280297 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:57.284280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.340736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eceffb872a4f48fa94f7df916625ad54'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.347876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eceffb872a4f48fa94f7df916625ad54'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.348744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eceffb872a4f48fa94f7df916625ad54'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.349987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eceffb872a4f48fa94f7df916625ad54'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.351654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39fd82-1076-46d2-a435-b58cb4ac9579 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.360221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.360221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.360221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.360221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] PATH_INFO: `/v3/users/d50ef1ad69614234a4f35b2a3bd0f5e9` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.360623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50ef1ad69614234a4f35b2a3bd0f5e9)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.362795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eceffb872a4f48fa94f7df916625ad54'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.362934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.454209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1101/2170] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:57 2022] DELETE /identity/v3/users/eceffb872a4f48fa94f7df916625ad54 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:57.456449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:57.458642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.518886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50ef1ad69614234a4f35b2a3bd0f5e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.529665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50ef1ad69614234a4f35b2a3bd0f5e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.533321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50ef1ad69614234a4f35b2a3bd0f5e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.533321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50ef1ad69614234a4f35b2a3bd0f5e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.542869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa3805-2fde-4d13-ad68-708f960feaee admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.549118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2bf4a29e-2128-46ff-9f0f-3ce63d986c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50ef1ad69614234a4f35b2a3bd0f5e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.555295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.556188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.556475 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.556810 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] PATH_INFO: `/v3/projects/b918f34b28b54e76b349b4e9addd1591` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.558108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b918f34b28b54e76b349b4e9addd1591)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.560049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.711504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1070/2171] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:57 2022] DELETE /identity/v3/users/d50ef1ad69614234a4f35b2a3bd0f5e9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:57.713564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.714241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.714704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.722609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b918f34b28b54e76b349b4e9addd1591', 'request_id': 'req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.730126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b918f34b28b54e76b349b4e9addd1591', 'request_id': 'req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.760139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:57.761494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.799734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:57.810668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b918f34b28b54e76b349b4e9addd1591', 'request_id': 'req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.827228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] The token cache is being invalidate because project b918f34b28b54e76b349b4e9addd1591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:57.827228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.827882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-de9b60f5-c17d-4f42-a0c8-b15e5dd0836c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:57.833090 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1102/2172] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:57 2022] DELETE /identity/v3/projects/b918f34b28b54e76b349b4e9addd1591 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:57.834632 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf252e-b8d8-406e-af5c-eedeb4b02da9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.835148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf252e-b8d8-406e-af5c-eedeb4b02da9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.835699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf252e-b8d8-406e-af5c-eedeb4b02da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.855272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1fdf252e-b8d8-406e-af5c-eedeb4b02da9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:57.856504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1fdf252e-b8d8-406e-af5c-eedeb4b02da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.857671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1071/2173] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:57.864825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1103/2174] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:57.868331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:57.869714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.874156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.874473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.874753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.893281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:57.894489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:57.902613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1104/2175] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:57.907041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:57.916215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b50838-5df7-40be-9379-86770bbe7483 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.922595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.923446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.923718 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.923991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.924732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:57.925038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.927203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.934010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd549-d343-4b7f-80f0-eb936a2f729a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.937875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.938536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.938822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.939098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.940427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1105/2176] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:12:57.945162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:57.952811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.954395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.955028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b548-5308-4a6d-b02b-86f96d0ac6b1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:57.961063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:57.963039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:57.963039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:57.963039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:57.963404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:57.965471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:57.965597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1072/2177] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:12:58.048674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1106/2178] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:57 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:58.055484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.066423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe819-ceb6-45b1-be6e-1b510f54e3c3 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.156734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.157481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.157773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.158054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.158771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.160726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.301977 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1073/2179] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:58 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:12:58.303646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.305948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.307272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.318754 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079ec3-062c-4364-b6f8-a6550815f42f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.324871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0c73-ebb2-4a6b-9695-c7d3713a8afb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.328703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.328703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.328703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.328703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.329048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.329917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.330837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.331028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.331356 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.331987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] PATH_INFO: `/v3/projects/36fd17a32ecd42c1acdbc450ff3a6c55` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.333365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36fd17a32ecd42c1acdbc450ff3a6c55)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.335932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.344941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1074/2180] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:58.351156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.363144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431e369-ebf3-4ef8-bd02-fb354840d1a0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.368770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.369458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.369744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.370206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.370942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.372612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.384749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1075/2181] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:58.389269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.399459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b81d-61c9-49ad-8a66-79fc4a769ffa admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.404500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.405419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.405709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.405986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] PATH_INFO: `/v3/projects/992c1fbe41f84a5d9d264d157f985287/users/3d2c575e91214540b3257154a0875236/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.422318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=992c1fbe41f84a5d9d264d157f985287, user_id=3d2c575e91214540b3257154a0875236, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.425073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.508447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1076/2182] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:58 2022] PUT /identity/v3/projects/992c1fbe41f84a5d9d264d157f985287/users/3d2c575e91214540b3257154a0875236/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:58.508447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.508447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.522955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36fd17a32ecd42c1acdbc450ff3a6c55', 'request_id': 'req-027195c2-175b-482e-babd-729a84f9119e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.530484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36fd17a32ecd42c1acdbc450ff3a6c55', 'request_id': 'req-027195c2-175b-482e-babd-729a84f9119e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.581406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a12aa-fe9a-4db5-9d6c-75e5ead7d58e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.639110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.640002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.640289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.640687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] PATH_INFO: `/v3/projects/3f4bd9910c424c57ad0de87b462b5b53` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.641967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4bd9910c424c57ad0de87b462b5b53)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.644051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.656595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36fd17a32ecd42c1acdbc450ff3a6c55', 'request_id': 'req-027195c2-175b-482e-babd-729a84f9119e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.674867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] The token cache is being invalidate because project 36fd17a32ecd42c1acdbc450ff3a6c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:58.675298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.676071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-027195c2-175b-482e-babd-729a84f9119e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.677786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1107/2183] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:58 2022] DELETE /identity/v3/projects/36fd17a32ecd42c1acdbc450ff3a6c55 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:58.679442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea2bb-0c93-443f-a268-a260e68ff614 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.679959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea2bb-0c93-443f-a268-a260e68ff614 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.680351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea2bb-0c93-443f-a268-a260e68ff614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.707326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ff7ea2bb-0c93-443f-a268-a260e68ff614 None None] MFA Rules not processed for user `3d2c575e91214540b3257154a0875236`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:58.709256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ff7ea2bb-0c93-443f-a268-a260e68ff614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.775404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1108/2184] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:58.776790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.777077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.777402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.801876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:58.803379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.810751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4bd9910c424c57ad0de87b462b5b53', 'request_id': 'req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.825719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4bd9910c424c57ad0de87b462b5b53', 'request_id': 'req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.875926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1109/2185] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:58.875926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.877409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.890265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2b52a-7247-4155-bee8-1aea3a79790e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.890881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4bd9910c424c57ad0de87b462b5b53', 'request_id': 'req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.895179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.895903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.896808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.897089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.897787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.899744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.904185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] The token cache is being invalidate because project 3f4bd9910c424c57ad0de87b462b5b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:12:58.904482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.905189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d12d7764-52fd-4e16-8111-0d3b2ae9d06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:58.907034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1077/2186] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:58 2022] DELETE /identity/v3/projects/3f4bd9910c424c57ad0de87b462b5b53 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:58.908441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.908731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.909413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.933862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:58.935086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.944137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1078/2187] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:12:58.947962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:58.949356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:58.961648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3acdf-f5dc-4347-86df-16fd5082017f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:58.966484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:58.967382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:58.967672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:58.967952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] PATH_INFO: `/v3/users/16e69d3204a5412a8f9720125a317a0f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:58.969196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e69d3204a5412a8f9720125a317a0f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:58.971101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:58.996503 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1110/2188] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:58 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:58.997393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.061973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb01d82-0657-4fd0-ab9e-ba06ca994232 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.066736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.067430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.067720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.068494 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.069224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:12:59.069533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.071161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.082684 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1111/2189] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:12:59.083554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.085778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:59.097823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f67fa1-4567-4c38-b6fc-8dea2b2b3624 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.102773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.103459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.103765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.104029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.104727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.106640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.207348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e69d3204a5412a8f9720125a317a0f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:59.214648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e69d3204a5412a8f9720125a317a0f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:59.215329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e69d3204a5412a8f9720125a317a0f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:59.215996 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e69d3204a5412a8f9720125a317a0f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:59.228052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e69d3204a5412a8f9720125a317a0f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:12:59.292992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1112/2190] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:59 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:59.294129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.295757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:59.308076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33894-f7bb-4645-96c8-177c3c24b105 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.312701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.313546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.313667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.313913 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.314822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.316760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.321392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1079/2191] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:12:58 2022] DELETE /identity/v3/users/16e69d3204a5412a8f9720125a317a0f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:59.322368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.323673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:59.403177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:59.416034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec4fe-a79c-44e4-ba76-4d6def7af7cb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.421231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1113/2192] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:12:59 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:59.423657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.424331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.425286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.425286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.426079 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.428213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.428736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.453980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1080/2193] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:59.457720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.493384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d56ab-88ad-4a2f-96de-7bd9a64ebc4b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.515853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d4f05-e667-41d2-bfde-c1426d5c201b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.520765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.521467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.521885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.522404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.522859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.524954 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.565657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.566482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.566768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.567045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] PATH_INFO: `/v3/projects/cb00d7041fed411c95b37900b5fe5807/users/e181e656fe8a43ef8703171871fe4220/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.582655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb00d7041fed411c95b37900b5fe5807, user_id=e181e656fe8a43ef8703171871fe4220, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.585527 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.617075 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1114/2194] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:12:59 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:12:59.618224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.629367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce4e1-0aea-47f7-b249-d2140b6c9046 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.638103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.638872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.639215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.644967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.644967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.644967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.654907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1115/2195] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:59.658843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.669534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499180-c03d-483e-b13f-5b6a04ec3a46 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.671531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1081/2196] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:59 2022] PUT /identity/v3/projects/cb00d7041fed411c95b37900b5fe5807/users/e181e656fe8a43ef8703171871fe4220/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:59.676337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.738388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.739293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.739687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.740749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.741568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.743601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.752503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acffb63-0e6c-4fb4-a237-5839542789ff admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.758927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1116/2197] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:12:59.760019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.761730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.762903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.763455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.763616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.764434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.766114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.770598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad89b-092a-475f-8c39-2364a474236d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.775586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.776585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.776770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.777054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] PATH_INFO: `/v3/projects/492b36d9fa4745e8b9d99c21b97b0e5c/users/3a227c380df6416fbdbfe6b010b32a3a/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.781187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1082/2198] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:12:59.783921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.794965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea997e5-489f-479e-926e-98a1123d031d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:12:59.797291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=492b36d9fa4745e8b9d99c21b97b0e5c, user_id=3a227c380df6416fbdbfe6b010b32a3a, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.800261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.805978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb79a3-8463-460a-aee3-afade9afeb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:12:59.806893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb79a3-8463-460a-aee3-afade9afeb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.807178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb79a3-8463-460a-aee3-afade9afeb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.807479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb79a3-8463-460a-aee3-afade9afeb6e admin admin] PATH_INFO: `/v3/projects/cb00d7041fed411c95b37900b5fe5807/users/e181e656fe8a43ef8703171871fe4220/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.809779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb79a3-8463-460a-aee3-afade9afeb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb00d7041fed411c95b37900b5fe5807, user_id=e181e656fe8a43ef8703171871fe4220, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:12:59.812428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb79a3-8463-460a-aee3-afade9afeb6e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:12:59.823069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1083/2199] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:59 2022] PUT /identity/v3/projects/cb00d7041fed411c95b37900b5fe5807/users/e181e656fe8a43ef8703171871fe4220/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:12:59.832858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc848-af8f-4872-9fe7-8422ba8186e0 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.838571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc848-af8f-4872-9fe7-8422ba8186e0 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.838571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc848-af8f-4872-9fe7-8422ba8186e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:12:59.858450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:59.862016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-37bfc848-af8f-4872-9fe7-8422ba8186e0 None None] MFA Rules not processed for user `e181e656fe8a43ef8703171871fe4220`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:12:59.863255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-37bfc848-af8f-4872-9fe7-8422ba8186e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:59.913544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1117/2200] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:12:59 2022] PUT /identity/v3/projects/492b36d9fa4745e8b9d99c21b97b0e5c/users/3a227c380df6416fbdbfe6b010b32a3a/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:12:59.914827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:12:59.925673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:12:59.965692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1084/2201] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:12:59.967319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8c48-b606-482c-a569-3874422a31de None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:12:59.967529 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8c48-b606-482c-a569-3874422a31de None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:12:59.967809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8c48-b606-482c-a569-3874422a31de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.022586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de72bd-db2a-4517-9f62-7f8e92fb57cc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.022794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4bef8c48-b606-482c-a569-3874422a31de None None] MFA Rules not processed for user `3a227c380df6416fbdbfe6b010b32a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:00.024417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4bef8c48-b606-482c-a569-3874422a31de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.029866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.030813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.031107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.031471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] PATH_INFO: `/v3/projects/d29eb0129f5a4ad18faf2f35777e325f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.032740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29eb0129f5a4ad18faf2f35777e325f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.034815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.109244 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1085/2202] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:12:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:00.111024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8c48-b606-482c-a569-3874422a31de None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.114059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4bef8c48-b606-482c-a569-3874422a31de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.131260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29eb0129f5a4ad18faf2f35777e325f', 'request_id': 'req-666b2f0a-996f-4103-9c80-529281911b83'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.139089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29eb0129f5a4ad18faf2f35777e325f', 'request_id': 'req-666b2f0a-996f-4103-9c80-529281911b83'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.177499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8c48-b606-482c-a569-3874422a31de None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.225959 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f1e1-c604-40f0-832e-c57d62563e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.226620 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f1e1-c604-40f0-832e-c57d62563e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.226906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f1e1-c604-40f0-832e-c57d62563e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.227190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f1e1-c604-40f0-832e-c57d62563e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.264171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29eb0129f5a4ad18faf2f35777e325f', 'request_id': 'req-666b2f0a-996f-4103-9c80-529281911b83'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.286467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] The token cache is being invalidate because project d29eb0129f5a4ad18faf2f35777e325f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:00.287663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.288963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.295777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1118/2203] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:12:59 2022] DELETE /identity/v3/projects/d29eb0129f5a4ad18faf2f35777e325f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:00.295777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.296803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.304346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f1e1-c604-40f0-832e-c57d62563e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.305936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f1e1-c604-40f0-832e-c57d62563e2a service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.310597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b2f0a-996f-4103-9c80-529281911b83 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.314866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.315553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.315840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.316126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.318053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.318921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1086/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:00.320398 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ced9-ca1d-4ed8-9323-95b1807cff37 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.324462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ced9-ca1d-4ed8-9323-95b1807cff37 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.324462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1ced9-ca1d-4ed8-9323-95b1807cff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.340125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-7ca1ced9-ca1d-4ed8-9323-95b1807cff37 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:00.343374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7ca1ced9-ca1d-4ed8-9323-95b1807cff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.437755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1087/2205] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:00.438726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.439021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.439500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.446001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.447902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.472808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1119/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:00.485017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:00.487771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.511283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1088/2207] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:00.514775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.529901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa92894-2bfa-4bf1-a38a-58a3df35284f service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.535734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.536349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.536768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.537141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.538004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:00.538406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.540213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.559123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1120/2208] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:13:00.560262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.572398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.574424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63781a-06d1-4b35-9b32-718411a124d3 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.574965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.580842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.581758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.582145 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.582810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.583406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.586993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.594623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a82d7-8841-4452-ae3a-b017ce32c44f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.602386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.603563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.605229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.605538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] PATH_INFO: `/v3/users/3d2c575e91214540b3257154a0875236` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.608926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2c575e91214540b3257154a0875236)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.609068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.734068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1089/2209] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:00 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:00.738065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.810861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc678-970d-473d-8b94-7ed07f4b0f9e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.815827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.816559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.816846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.817129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.817838 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.820476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.889351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2c575e91214540b3257154a0875236'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.896298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2c575e91214540b3257154a0875236'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.896970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2c575e91214540b3257154a0875236'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.897581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2c575e91214540b3257154a0875236'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.910757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-9d4d345a-e47e-45a1-8ba4-83223f807bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2c575e91214540b3257154a0875236'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:00.911022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1090/2210] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:00 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:00.915373 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.917173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:00.932424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ecd9-1f5d-4774-bbd9-31980960447e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.937583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.946141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.946141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.946141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.946141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.946141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.952525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1091/2211] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:00.956484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.966171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f4c0e-6c54-4658-bce0-246bdcf1f575 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:00.971103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:00.971868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:00.972150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:00.974885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:00.974885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:00.974885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:00.985896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1092/2212] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:00.990366 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:00.999962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1121/2213] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:00 2022] DELETE /identity/v3/users/3d2c575e91214540b3257154a0875236 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:01.003592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e26f-9622-441b-91bf-81b33a94ed16 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.007558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.008074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.008425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.032792 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:01.034116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:01.077170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.078069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.078352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.078681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] PATH_INFO: `/v3/projects/f3292199646b4d25a9bc77a038be6204/users/4b7a93ebab4c4b0c8342d65475133c21/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.101060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3292199646b4d25a9bc77a038be6204, user_id=4b7a93ebab4c4b0c8342d65475133c21, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.101060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.101324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1122/2214] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:01.109518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.110960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:01.173310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a806-30c5-474e-82b9-d58bf2e0470a None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.177074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330c2f9-1c83-4bfa-a800-962d45626008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.178361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c2f9-1c83-4bfa-a800-962d45626008 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.178643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c2f9-1c83-4bfa-a800-962d45626008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.178981 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c2f9-1c83-4bfa-a800-962d45626008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.190360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330c2f9-1c83-4bfa-a800-962d45626008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.191847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330c2f9-1c83-4bfa-a800-962d45626008 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.201444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1123/2215] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:01.225878 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1093/2216] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:00 2022] PUT /identity/v3/projects/f3292199646b4d25a9bc77a038be6204/users/4b7a93ebab4c4b0c8342d65475133c21/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:01.235726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b794-779f-4a7b-ac55-9308054b01e6 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.235996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b794-779f-4a7b-ac55-9308054b01e6 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.236286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65b794-779f-4a7b-ac55-9308054b01e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.264581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2c65b794-779f-4a7b-ac55-9308054b01e6 None None] MFA Rules not processed for user `4b7a93ebab4c4b0c8342d65475133c21`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:01.266688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:01.267439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2c65b794-779f-4a7b-ac55-9308054b01e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:01.352859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1124/2217] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:01.356697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.420003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.420330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.420558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.439048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e46c73-1497-4822-81bf-3be12ae25070 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.444186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] MFA Rules not processed for user `bc0272ac06464fb7b430bc8c664208dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:01.445012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.445689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.445852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:01.445972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.446253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.446965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.449005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.515914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1125/2218] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:01.538806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1094/2219] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:01 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:01.538806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:01.540647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.554823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6cd6c-d544-4361-b855-ab077319d410 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.623958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.624812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.625142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.625500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.626249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.631272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.753413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1126/2220] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:01 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:01.755039 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.755525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.757164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:01.766324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461d9b-271c-4f75-9d90-a9807c146397 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.772490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.773234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.773535 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.773851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.774755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.775035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b0c68-f72c-49f3-9257-a7fda903502f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.780856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.781530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.781724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.782015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.782292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] PATH_INFO: `/v3/projects/992c1fbe41f84a5d9d264d157f985287` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.783944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=992c1fbe41f84a5d9d264d157f985287)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.799705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1127/2221] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:01.800104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.802416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.812986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7a69-a9a6-4c00-a613-867510e022b0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:01.818498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:01.820449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:01.820737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:01.821016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] PATH_INFO: `/v3/projects/5195c288f64747c7bb2f5114f1523109/users/f91ed15578244d3fb43ed0574b2fc779/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:01.837272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5195c288f64747c7bb2f5114f1523109, user_id=f91ed15578244d3fb43ed0574b2fc779, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:01.839980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:01.932800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1128/2222] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:01 2022] PUT /identity/v3/projects/5195c288f64747c7bb2f5114f1523109/users/f91ed15578244d3fb43ed0574b2fc779/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:01.936395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:01.938461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992c1fbe41f84a5d9d264d157f985287', 'request_id': 'req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:01.946906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992c1fbe41f84a5d9d264d157f985287', 'request_id': 'req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.002274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29809fb0-2e7b-4650-9bc5-406cf957dcdb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:02.024469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992c1fbe41f84a5d9d264d157f985287', 'request_id': 'req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.036427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] The token cache is being invalidate because project 992c1fbe41f84a5d9d264d157f985287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:02.037409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.038194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.040230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1095/2223] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:01 2022] DELETE /identity/v3/projects/992c1fbe41f84a5d9d264d157f985287 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:02.044577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:02.046159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:02.067581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:02.068647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:02.068901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:02.069258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:02.070398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:02.072305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:02.085032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1129/2224] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:02.088980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:02.091033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:02.109994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b085-3d3a-4c56-a3f9-ef0d809707fc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:02.127287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b104-0faa-4c35-a0e2-802920c6b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:02.127483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9a674-a1ac-4f42-aa8f-d01e97d5ed3e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:02.128319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b104-0faa-4c35-a0e2-802920c6b9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:02.128604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b104-0faa-4c35-a0e2-802920c6b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:02.128876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b104-0faa-4c35-a0e2-802920c6b9a0 admin admin] PATH_INFO: `/v3/projects/5195c288f64747c7bb2f5114f1523109/users/f91ed15578244d3fb43ed0574b2fc779/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:02.131176 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5b104-0faa-4c35-a0e2-802920c6b9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5195c288f64747c7bb2f5114f1523109, user_id=f91ed15578244d3fb43ed0574b2fc779, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:02.137248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:02.138488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:02.142391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:02.142506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5b104-0faa-4c35-a0e2-802920c6b9a0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:02.142602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] PATH_INFO: `/v3/users/e181e656fe8a43ef8703171871fe4220` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:02.142602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e181e656fe8a43ef8703171871fe4220)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:02.145226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:02.156698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1130/2225] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:02 2022] PUT /identity/v3/projects/5195c288f64747c7bb2f5114f1523109/users/f91ed15578244d3fb43ed0574b2fc779/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:02.168059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:02.168469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:02.168754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:02.201587 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] MFA Rules not processed for user `f91ed15578244d3fb43ed0574b2fc779`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:02.203058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:02.278212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1131/2226] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:02.299679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:02.301113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:02.368008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e181e656fe8a43ef8703171871fe4220'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.381171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e181e656fe8a43ef8703171871fe4220'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.383287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e181e656fe8a43ef8703171871fe4220'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.384185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e181e656fe8a43ef8703171871fe4220'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.390323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bddb3-36bb-43d5-9209-b90c1130b210 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:02.401033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:02.402205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:02.402859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:02.402859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:02.408339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:02.410449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e181e656fe8a43ef8703171871fe4220'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:02.427840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:02.429397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:02.442158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1132/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:02.511714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1096/2228] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:02 2022] DELETE /identity/v3/users/e181e656fe8a43ef8703171871fe4220 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:02.647547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:03.013740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:03.015948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:03.100206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:03.102691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:03.133788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5842b7-2c4c-4fdf-8f69-9dba2b731390 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:03.368175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:03.368175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:03.368175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:03.368175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] PATH_INFO: `/v3/projects/cb00d7041fed411c95b37900b5fe5807` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:03.369287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb00d7041fed411c95b37900b5fe5807)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:03.369287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:03.369854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cad43-a540-475d-9a15-be75847c5d39 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:03.369854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:03.369854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:03.369854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:03.370271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] PATH_INFO: `/v3/users/4b7a93ebab4c4b0c8342d65475133c21` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:03.370271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7a93ebab4c4b0c8342d65475133c21)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:03.370271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:03.612091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb00d7041fed411c95b37900b5fe5807', 'request_id': 'req-e6255b00-ad62-4cd8-bae2-780a5b803604'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.619533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7a93ebab4c4b0c8342d65475133c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.619742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb00d7041fed411c95b37900b5fe5807', 'request_id': 'req-e6255b00-ad62-4cd8-bae2-780a5b803604'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.629800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:03.641458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7a93ebab4c4b0c8342d65475133c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.644004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7a93ebab4c4b0c8342d65475133c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.645385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7a93ebab4c4b0c8342d65475133c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.666872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ef77b541-2df6-4d92-87c6-c5a8529d8703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7a93ebab4c4b0c8342d65475133c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.743598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb00d7041fed411c95b37900b5fe5807', 'request_id': 'req-e6255b00-ad62-4cd8-bae2-780a5b803604'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.755080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] The token cache is being invalidate because project cb00d7041fed411c95b37900b5fe5807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:03.755398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.756036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e6255b00-ad62-4cd8-bae2-780a5b803604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:03.757601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1133/2229] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:03 2022] DELETE /identity/v3/projects/cb00d7041fed411c95b37900b5fe5807 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:03.762569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d238-f93f-412c-b990-9412d8217532 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:03.762972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d238-f93f-412c-b990-9412d8217532 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:03.763275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d238-f93f-412c-b990-9412d8217532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:03.791380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9582d238-f93f-412c-b990-9412d8217532 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:03.792572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9582d238-f93f-412c-b990-9412d8217532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:03.835096 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1097/2230] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:03 2022] DELETE /identity/v3/users/4b7a93ebab4c4b0c8342d65475133c21 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:03.839537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:03.839832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:03.840118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:03.854103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1134/2231] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:03.857906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:03.860616 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:03.862680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:03.862960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:03.863253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:03.892128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:03.893386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:03.921256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1098/2232] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:03.928991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:03.930593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:03.973536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1135/2233] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:03.978420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:03.987133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f80bc7-4647-4263-b412-844d62434476 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:03.991749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:03.992393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:03.992678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:03.992967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:03.993687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:03.993992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:03.995623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.007439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1136/2234] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:13:04.011713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.016571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9ed2-2364-4f4e-8117-1bd3848d5125 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.020572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.021787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87a3bb-7162-4999-a7b7-9236216c2d8a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.022739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.023029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.023343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.027013 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.027700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.027978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.028274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.028966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.030848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.034589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.036081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.047920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1099/2235] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:04.116142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1137/2236] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:04 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:04.120540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.130791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183511b5-9620-4f4c-ba27-5807829e7306 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.187993 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.188665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.188953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.189228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.189925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.191918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.276073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1100/2237] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:04 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:04.281159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.291111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a364-7648-4e05-9085-9e83f84327f7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.295994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.296671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.296956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.297236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.297976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.299721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.314125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1138/2238] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:04.316743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.327192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925232d-7372-4cf4-8a08-e372634dd237 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.333481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.336837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.336837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.336837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.336837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.338156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.348419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1101/2239] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:04.352624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.362653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462e550-00ea-4b84-bca2-6a2fb7aab3d8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.367405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd807-86e4-4e2c-86ef-7412c52ad392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.369140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd807-86e4-4e2c-86ef-7412c52ad392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.369140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd807-86e4-4e2c-86ef-7412c52ad392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.369140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd807-86e4-4e2c-86ef-7412c52ad392 admin admin] PATH_INFO: `/v3/projects/0d9acf96e7764fc7bd15b2158c4a5290/users/0e586baa556646ae81f90ca41d90aa19/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.393461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cd807-86e4-4e2c-86ef-7412c52ad392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9acf96e7764fc7bd15b2158c4a5290, user_id=0e586baa556646ae81f90ca41d90aa19, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.396706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cd807-86e4-4e2c-86ef-7412c52ad392 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.470330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.472134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:04.486388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578b44-c3dd-4315-817c-a47dc7202ec4 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.492120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.492985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.493266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.493539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] PATH_INFO: `/v3/projects/f3292199646b4d25a9bc77a038be6204` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.494769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3292199646b4d25a9bc77a038be6204)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.500833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.504251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1139/2240] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:04 2022] PUT /identity/v3/projects/0d9acf96e7764fc7bd15b2158c4a5290/users/0e586baa556646ae81f90ca41d90aa19/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:04.515216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.515636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.516164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.541408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] MFA Rules not processed for user `0e586baa556646ae81f90ca41d90aa19`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:04.542653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:04.606433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1140/2241] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:04.610884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.627506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3292199646b4d25a9bc77a038be6204', 'request_id': 'req-8d2d0218-b1a7-4b7b-8423-416769804832'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:04.635685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3292199646b4d25a9bc77a038be6204', 'request_id': 'req-8d2d0218-b1a7-4b7b-8423-416769804832'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:04.681695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fea42-a128-4510-ab07-f6846d2b43d0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.725078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3292199646b4d25a9bc77a038be6204', 'request_id': 'req-8d2d0218-b1a7-4b7b-8423-416769804832'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:04.738713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] The token cache is being invalidate because project f3292199646b4d25a9bc77a038be6204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:04.739016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:04.742629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:04.743752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:04.744302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1102/2242] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:04 2022] DELETE /identity/v3/projects/f3292199646b4d25a9bc77a038be6204 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:04.750095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.754112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:04.788923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.789733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.790086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.790339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.791127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.793079 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.821629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0218-b1a7-4b7b-8423-416769804832 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.826582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.831555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.831555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.831555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] PATH_INFO: `/v3/users/f91ed15578244d3fb43ed0574b2fc779` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.831555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91ed15578244d3fb43ed0574b2fc779)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.831963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:04.893014 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1141/2243] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:04 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:04.896933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:04.898505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:04.959737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6118d6-01ff-41a0-9d92-14aa2a47b507 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:04.964627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:04.965308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:04.965599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:04.965877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:04.966569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:04.968654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.035178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91ed15578244d3fb43ed0574b2fc779'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.042573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91ed15578244d3fb43ed0574b2fc779'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.043225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91ed15578244d3fb43ed0574b2fc779'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.043861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91ed15578244d3fb43ed0574b2fc779'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.056540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-cf530c76-b746-4777-ab32-30278e0455a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91ed15578244d3fb43ed0574b2fc779'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.059639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1142/2244] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:04 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:05.060720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.062457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:05.074572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3a1a4-fc9c-4f6c-85a6-fadfd9e8faf4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.079277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.079941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.080227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.080510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.081242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.083031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.094899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1143/2245] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:05.098109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.108127 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d170b-5078-4a51-a611-70fa73740468 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.112764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.113398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.122969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.122969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.122969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.122969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.128761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1144/2246] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:05.132707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.142271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f118de-c5e0-4d5a-9b2c-e60ff12c5cb7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.146838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.147709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.147990 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.151882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] PATH_INFO: `/v3/projects/4187d0f231034d8882b8a8f47997c579/users/cb038e80245540b8a43f101f2d28fbc8/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.154461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1103/2247] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:04 2022] DELETE /identity/v3/users/f91ed15578244d3fb43ed0574b2fc779 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:05.163012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4187d0f231034d8882b8a8f47997c579, user_id=cb038e80245540b8a43f101f2d28fbc8, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.165687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.233689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1145/2248] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:05 2022] PUT /identity/v3/projects/4187d0f231034d8882b8a8f47997c579/users/cb038e80245540b8a43f101f2d28fbc8/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:05.245536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.245890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.246201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.256204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:05.274784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] MFA Rules not processed for user `cb038e80245540b8a43f101f2d28fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:05.276006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:05.341981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1104/2249] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:05.346514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.410213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec40d3-bf3b-422c-a072-8287e4ff86dc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.416266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.416939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.417217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.417491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.418197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.420308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.539617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.543368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1146/2250] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:05 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:05.543501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:05.547790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.555730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ef46-7b9d-4e01-8a64-03d1440c7cbe None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.617793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092bdd-5a23-4daf-9798-baf6666a2a45 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.619785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.620661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.621018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.621290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] PATH_INFO: `/v3/projects/5195c288f64747c7bb2f5114f1523109` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.622497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.622634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5195c288f64747c7bb2f5114f1523109)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.623169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.623513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.623791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.624480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.624581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.626371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.635936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:05.719635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1147/2251] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:05 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:05.723357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.730564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5195c288f64747c7bb2f5114f1523109', 'request_id': 'req-93afcd11-6660-4019-8087-82f305e09360'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.733772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a493-a43a-4ad7-b495-e5062b523251 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.736936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5195c288f64747c7bb2f5114f1523109', 'request_id': 'req-93afcd11-6660-4019-8087-82f305e09360'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.802653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.803455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.803743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.804124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.804929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.806663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.827643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1148/2252] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:05.838682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5195c288f64747c7bb2f5114f1523109', 'request_id': 'req-93afcd11-6660-4019-8087-82f305e09360'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.842040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.842579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] The token cache is being invalidate because project 5195c288f64747c7bb2f5114f1523109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:05.842872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.843554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-93afcd11-6660-4019-8087-82f305e09360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:05.845130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1105/2253] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:05 2022] DELETE /identity/v3/projects/5195c288f64747c7bb2f5114f1523109 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:05.849719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0d9d6-0fea-4d44-9a7b-176b11adab2e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.850245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0d9d6-0fea-4d44-9a7b-176b11adab2e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.850534 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0d9d6-0fea-4d44-9a7b-176b11adab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.852924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf705-3576-4ce5-bcb5-2f7aff151084 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.859857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.860757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.861042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.861323 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] PATH_INFO: `/v3/projects/10f3c8d8f1bb4c709a7de2d9662b6ca1/users/2943f9e6b7bf4fdaac3c5b5bc14fe70a/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.869500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c9c0d9d6-0fea-4d44-9a7b-176b11adab2e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:05.870941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c9c0d9d6-0fea-4d44-9a7b-176b11adab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:05.876914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f3c8d8f1bb4c709a7de2d9662b6ca1, user_id=2943f9e6b7bf4fdaac3c5b5bc14fe70a, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.879454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1106/2254] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:05.880678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.888118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.888408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.888687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.908433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:05.909721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:05.918427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1107/2255] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:05.928153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.937516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecbffa-1703-4c80-88b6-afb73e72b552 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:05.942332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:05.943569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:05.943857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:05.944483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:05.945536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:05.945536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:05.947006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:05.950573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1149/2256] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:05 2022] PUT /identity/v3/projects/10f3c8d8f1bb4c709a7de2d9662b6ca1/users/2943f9e6b7bf4fdaac3c5b5bc14fe70a/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:05.962986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1108/2257] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:13:05.963209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.964114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:05.964665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:05.974707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9cf37-9fc8-4912-bb56-5c08c4270859 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.006282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.029788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d52d1a-b7a0-40df-87aa-41d4f52a78c1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.032591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.047439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.047439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.047439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.047439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.047802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.047802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.047802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.047802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.048085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.048156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.048156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.048918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1150/2258] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:06.052920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.062540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5edf-8701-4fc8-b6c6-c149e1f95864 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.067349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e17a4-304d-4341-85cd-9d7997e7af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.068272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e17a4-304d-4341-85cd-9d7997e7af6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.068559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e17a4-304d-4341-85cd-9d7997e7af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.068839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e17a4-304d-4341-85cd-9d7997e7af6e admin admin] PATH_INFO: `/v3/projects/10f3c8d8f1bb4c709a7de2d9662b6ca1/users/2943f9e6b7bf4fdaac3c5b5bc14fe70a/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.070807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e17a4-304d-4341-85cd-9d7997e7af6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f3c8d8f1bb4c709a7de2d9662b6ca1, user_id=2943f9e6b7bf4fdaac3c5b5bc14fe70a, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.073467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e17a4-304d-4341-85cd-9d7997e7af6e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.085720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1151/2259] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:06 2022] PUT /identity/v3/projects/10f3c8d8f1bb4c709a7de2d9662b6ca1/users/2943f9e6b7bf4fdaac3c5b5bc14fe70a/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:06.099582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.100028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.100180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.126329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] MFA Rules not processed for user `2943f9e6b7bf4fdaac3c5b5bc14fe70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:06.127573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:06.137563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1109/2260] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:05 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:06.141617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.153839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.198457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1152/2261] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:06.204374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a9443-33bc-4860-b9fe-3baa628d9fcf admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.209785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.210083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.210653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.211559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:06.212151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.212672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.212966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.213717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.215739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.270500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e74b8c-9858-44c1-a308-10a3a2a43712 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.301992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1110/2262] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:06 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:06.306554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.313201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.318795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2868-31a8-41bd-bd16-33a81a2934f1 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.319827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6c63-40e8-4dbd-b9fc-1f1f6db6a0c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.320589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6c63-40e8-4dbd-b9fc-1f1f6db6a0c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.320869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6c63-40e8-4dbd-b9fc-1f1f6db6a0c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.321141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6c63-40e8-4dbd-b9fc-1f1f6db6a0c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.323479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.324136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.324416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.324733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.325581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.328199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.339258 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1111/2263] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:06.343041 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.354504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4952e-8a8d-4803-9d84-35a24792c33c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.359379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.360070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.360354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.360632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.361354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.362954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.374179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1112/2264] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:06.379465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.390333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57797fe-82b7-41dc-8c3c-fc6bddea6fc3 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.393367 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c6c63-40e8-4dbd-b9fc-1f1f6db6a0c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.397935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c6c63-40e8-4dbd-b9fc-1f1f6db6a0c7 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.398044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.398044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.398044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.398044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] PATH_INFO: `/v3/projects/1b105397e253414e8ba5124358a29ac5/users/08ae587bdfdb4dcfa34ca7d128393ffb/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.406167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1153/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:06.415003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b105397e253414e8ba5124358a29ac5, user_id=08ae587bdfdb4dcfa34ca7d128393ffb, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.417932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.419264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.446377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.503479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1113/2266] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:06 2022] PUT /identity/v3/projects/1b105397e253414e8ba5124358a29ac5/users/08ae587bdfdb4dcfa34ca7d128393ffb/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:06.508838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.509625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.509625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.533787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:06.536979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:06.548035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.550921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:06.597459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1154/2267] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:06.608273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:06.609785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:06.616924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073092b1-4f1c-4605-9996-67b7fd3786f9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.622827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.623683 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.624048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.624379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.626307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:06.673802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b115-e83a-4828-b193-cb319f48a970 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:06.678064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:06.678820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:06.679183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:06.679670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:06.689329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.689693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:06.690967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.691278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe6f5-ed63-47eb-8b49-722318fa33a7 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:06.701225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1114/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:06.711015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1155/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:06.738177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:06.905014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:07.051199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:07.720585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:08.048174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:08.364087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:08.364374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:08.365188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:08.395528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] MFA Rules not processed for user `08ae587bdfdb4dcfa34ca7d128393ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:08.396804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:08.463153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1115/2270] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:08.467978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:08.479495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58526f-e9d2-4bc8-b658-039b6a2f1500 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:08.484093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:08.484875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:08.485186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:08.485458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:08.486146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:08.488061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:08.624652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1156/2271] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:08 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:08.628782 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:08.639773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5a9e-19dc-484a-bdc3-91a109f06697 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:08.696205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:08.696875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:08.697157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:08.697430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:08.698127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:08.700073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:08.794291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1116/2272] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:08 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:08.798177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:08.827801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f32a9-73ec-44f5-b37c-85b4ef98bf3a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:08.832370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:08.833028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:08.833309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:08.833581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:08.834301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:08.835932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:08.849421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1157/2273] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:08.850557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:08.880840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ab790-a06e-416b-93b3-60138811257a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:08.886517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:08.887730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:08.888062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:08.888236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] PATH_INFO: `/v3/projects/c364d14d035743e18999ec2edd4528a1/users/e2ebe3d44b064f3884b8d4237e618fbb/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:08.907564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c364d14d035743e18999ec2edd4528a1, user_id=e2ebe3d44b064f3884b8d4237e618fbb, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:08.910992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:09.005482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1117/2274] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:08 2022] PUT /identity/v3/projects/c364d14d035743e18999ec2edd4528a1/users/e2ebe3d44b064f3884b8d4237e618fbb/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:09.008046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:09.019263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcaa83-063a-4be1-9a97-680dd4c0314e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:09.085644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db954e43-2269-4785-afaa-39906c8ed2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:09.085644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954e43-2269-4785-afaa-39906c8ed2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:09.085644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954e43-2269-4785-afaa-39906c8ed2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:09.086347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954e43-2269-4785-afaa-39906c8ed2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:09.086616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db954e43-2269-4785-afaa-39906c8ed2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:09.088269 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db954e43-2269-4785-afaa-39906c8ed2e8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:09.105830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:09.109440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1158/2275] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:09.120190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191338f-a937-48bd-ad1f-409c3ca6fbba admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:09.122421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:09.123369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:09.123655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:09.123929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] PATH_INFO: `/v3/projects/c364d14d035743e18999ec2edd4528a1/users/e2ebe3d44b064f3884b8d4237e618fbb/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:09.126176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c364d14d035743e18999ec2edd4528a1, user_id=e2ebe3d44b064f3884b8d4237e618fbb, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:09.129032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:09.143440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1118/2276] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:09 2022] PUT /identity/v3/projects/c364d14d035743e18999ec2edd4528a1/users/e2ebe3d44b064f3884b8d4237e618fbb/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:09.437604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:09.595738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:10.498629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:10.499167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:10.499303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:10.527963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:10.530624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] MFA Rules not processed for user `e2ebe3d44b064f3884b8d4237e618fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:10.532004 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:10.602021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1159/2277] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:10.614284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:10.677991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a0d79-c4de-4898-a5b6-f81ba77dc2a0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:10.684600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404189-7174-4948-b969-8bae5adb1cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:10.685420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404189-7174-4948-b969-8bae5adb1cfa service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:10.685761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404189-7174-4948-b969-8bae5adb1cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:10.686111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404189-7174-4948-b969-8bae5adb1cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:10.754522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404189-7174-4948-b969-8bae5adb1cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:10.756608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404189-7174-4948-b969-8bae5adb1cfa service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:10.766320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1119/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:10.846170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:11.269994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:11.766272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:11.800229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:11.868412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:12.281187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:15.759172 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:15.769615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f1359-d1c7-4006-9029-681d7c84c250 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:15.773789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:15.774476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:15.774764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:15.775040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:15.785229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:15.787365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:15.797903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1160/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:18.670588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:18.671072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:18.671289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:18.690259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:18.691609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:18.752205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:18.766343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1120/2280] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:13:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:18.827625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:18.829994 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:18.917849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f79a-b4c0-4785-9543-4dc37892c185 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:18.923078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201adf5-407f-48c6-83ad-9009de73d751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:18.923786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201adf5-407f-48c6-83ad-9009de73d751 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:18.924066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201adf5-407f-48c6-83ad-9009de73d751 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:18.924349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201adf5-407f-48c6-83ad-9009de73d751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:18.933474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201adf5-407f-48c6-83ad-9009de73d751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:18.935081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201adf5-407f-48c6-83ad-9009de73d751 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:18.943750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1161/2281] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:13:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:13:19.983385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:20.175733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381e10-7b2f-4fec-96ba-8e62269017b6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:20.181331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:20.182743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:20.183176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:20.183862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] PATH_INFO: `/v3/users/0e586baa556646ae81f90ca41d90aa19` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:20.185271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e586baa556646ae81f90ca41d90aa19)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:20.187437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:20.413492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e586baa556646ae81f90ca41d90aa19'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:20.421902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e586baa556646ae81f90ca41d90aa19'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:20.422684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e586baa556646ae81f90ca41d90aa19'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:20.423588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e586baa556646ae81f90ca41d90aa19'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:20.460808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e586baa556646ae81f90ca41d90aa19'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:20.571927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1121/2282] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:19 2022] DELETE /identity/v3/users/0e586baa556646ae81f90ca41d90aa19 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:20.573322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:20.573844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:20.573946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:20.629028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:20.632145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:20.737139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:20.754279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1162/2283] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:20.761550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:20.764537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:20.861444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674fb85-3c87-4782-84d3-2b447bf9678c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:20.866967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:20.869010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:20.869010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:20.869010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:20.882231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:20.885378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:20.909658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1122/2284] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:21.449024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:21.450915 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:21.475703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980a6c-3edd-442e-a625-161ccb0b4434 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:21.481492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:21.482611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:21.483043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:21.483498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] PATH_INFO: `/v3/projects/0d9acf96e7764fc7bd15b2158c4a5290` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:21.485340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9acf96e7764fc7bd15b2158c4a5290)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:21.487449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:21.635829 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9acf96e7764fc7bd15b2158c4a5290', 'request_id': 'req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:21.644309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9acf96e7764fc7bd15b2158c4a5290', 'request_id': 'req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:21.720296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9acf96e7764fc7bd15b2158c4a5290', 'request_id': 'req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:21.733689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] The token cache is being invalidate because project 0d9acf96e7764fc7bd15b2158c4a5290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:21.734188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:21.735255 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:21.737357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1163/2285] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:21 2022] DELETE /identity/v3/projects/0d9acf96e7764fc7bd15b2158c4a5290 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:21.744596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:21.750703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:21.756369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5e4c2-d9a5-47e7-b7a7-1da23a61f3f8 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:21.828500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:21.829365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:21.829652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:21.829926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] PATH_INFO: `/v3/users/cb038e80245540b8a43f101f2d28fbc8` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:21.831164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb038e80245540b8a43f101f2d28fbc8)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:21.833956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:22.073803 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb038e80245540b8a43f101f2d28fbc8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:22.083712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb038e80245540b8a43f101f2d28fbc8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:22.084457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb038e80245540b8a43f101f2d28fbc8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:22.085090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb038e80245540b8a43f101f2d28fbc8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:22.101250 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4caea1a8-67a8-45ae-9d51-87e59f6efe55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb038e80245540b8a43f101f2d28fbc8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:22.224976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1123/2286] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:21 2022] DELETE /identity/v3/users/cb038e80245540b8a43f101f2d28fbc8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:22.873050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:22.874809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:22.909235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca629fc-de7b-41a2-97c5-ea21325b8a7d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:23.133804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:23.134730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:23.134991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:23.135294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] PATH_INFO: `/v3/projects/4187d0f231034d8882b8a8f47997c579` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:23.139514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4187d0f231034d8882b8a8f47997c579)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:23.144868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:23.280033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4187d0f231034d8882b8a8f47997c579', 'request_id': 'req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.287578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4187d0f231034d8882b8a8f47997c579', 'request_id': 'req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.297318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:23.297804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:23.297937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:23.350094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:23.351889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:23.421636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4187d0f231034d8882b8a8f47997c579', 'request_id': 'req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.433536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] The token cache is being invalidate because project 4187d0f231034d8882b8a8f47997c579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:23.434277 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.435028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.436557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1124/2287] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:13:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:23.445679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1164/2288] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:22 2022] DELETE /identity/v3/projects/4187d0f231034d8882b8a8f47997c579 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:23.460498 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:23.461248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:23.462460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:23.463086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:23.486389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:23.496275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:23.566894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aee73-f5c2-43be-8f89-ed20592f0491 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:23.578953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd9e94-c5cb-4e69-a7c4-bd25790c17ac admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:23.580226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:23.581104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:23.581769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:23.582119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:23.584330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:23.588912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:23.590168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:23.590306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:23.590647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] PATH_INFO: `/v3/users/2943f9e6b7bf4fdaac3c5b5bc14fe70a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:23.592096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2943f9e6b7bf4fdaac3c5b5bc14fe70a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:23.597702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:23.601507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:23.604022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:23.618960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1125/2289] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:13:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:13:23.785686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2943f9e6b7bf4fdaac3c5b5bc14fe70a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.803129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2943f9e6b7bf4fdaac3c5b5bc14fe70a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.804160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2943f9e6b7bf4fdaac3c5b5bc14fe70a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.804811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2943f9e6b7bf4fdaac3c5b5bc14fe70a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.830473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cd035273-8741-4182-b080-ea410099fde5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2943f9e6b7bf4fdaac3c5b5bc14fe70a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:23.954195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1165/2290] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:23 2022] DELETE /identity/v3/users/2943f9e6b7bf4fdaac3c5b5bc14fe70a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:24.761288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:24.779990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a74ec-6143-445d-bc12-34d0046d40be service swift] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:24.970464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:24.971383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:24.971706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:24.971988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] PATH_INFO: `/v3/projects/10f3c8d8f1bb4c709a7de2d9662b6ca1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:24.973716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f3c8d8f1bb4c709a7de2d9662b6ca1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:24.976527 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:25.156062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f3c8d8f1bb4c709a7de2d9662b6ca1', 'request_id': 'req-21e1c19c-251c-45ea-ab5a-8bf962353707'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:25.175933 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f3c8d8f1bb4c709a7de2d9662b6ca1', 'request_id': 'req-21e1c19c-251c-45ea-ab5a-8bf962353707'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:25.241055 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f3c8d8f1bb4c709a7de2d9662b6ca1', 'request_id': 'req-21e1c19c-251c-45ea-ab5a-8bf962353707'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:25.259990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] The token cache is being invalidate because project 10f3c8d8f1bb4c709a7de2d9662b6ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:25.260385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:25.261152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-21e1c19c-251c-45ea-ab5a-8bf962353707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:25.265690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1126/2291] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:24 2022] DELETE /identity/v3/projects/10f3c8d8f1bb4c709a7de2d9662b6ca1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:25.273859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:25.275401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:25.276272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:25.470331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:25.476339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:25.656070 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1166/2292] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:25.657623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:25.657623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:25.658448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:25.697794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:25.699040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:25.721292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1127/2293] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:25.725942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:25.733752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:25.744566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa2d3f-171d-4724-9308-4457e9dc9949 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:25.769461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:25.770357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:25.776032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:25.776032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:25.776032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:25.776032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:25.776032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:25.813488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1167/2294] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:13:25.818317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:25.840870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f41ee-62b3-409f-9936-b13571d46208 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:25.851506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:25.852277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:25.852577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:25.852851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:25.853772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:25.859320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:25.905353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:25.908472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:25.945850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2bd6e-8ec1-4a55-b55f-62a53562f60f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:25.958159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:25.959640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:25.960101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:25.960621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] PATH_INFO: `/v3/users/3a227c380df6416fbdbfe6b010b32a3a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:25.962137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a227c380df6416fbdbfe6b010b32a3a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:25.964410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:25.984606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1128/2295] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:25 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:25.990966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:26.028069 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:26.229914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144469-433a-47e8-a020-c9c3ae82f5a7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:26.254149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:26.256050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:26.256572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:26.257291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:26.257888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:26.259955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:26.436962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a227c380df6416fbdbfe6b010b32a3a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:26.453113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a227c380df6416fbdbfe6b010b32a3a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:26.454223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a227c380df6416fbdbfe6b010b32a3a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:26.455053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a227c380df6416fbdbfe6b010b32a3a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:26.479953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-18ef5cd3-de7c-46ca-ab3e-bb66eea817b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a227c380df6416fbdbfe6b010b32a3a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:26.501178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1129/2296] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:25 2022] POST /identity/v3/users => generated 283 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:26.505156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:26.507716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:26.526051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b0ef-1338-4480-9c91-0f82f48cd4c3 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:26.538510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:26.539897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:26.540553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:26.541273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:26.548261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:26.550188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:26.594294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1168/2297] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:25 2022] DELETE /identity/v3/users/3a227c380df6416fbdbfe6b010b32a3a => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:26.596155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:26.596685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:26.597147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:26.604906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1130/2298] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:26.610449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:26.639487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5c06a-6f9b-4f2e-8c60-3733b7ba88f8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:26.643623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:26.646796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:26.728773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:26.729575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:26.729986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:26.731036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:26.731922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:26.734292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:26.777295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1131/2299] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:26.778172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:26.792715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1169/2300] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:26.794592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230fe1-351b-4df5-ab0b-99bdf801ac06 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:26.802860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:26.805034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:26.816251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab398-90ff-40c0-bf2f-31a0cef3d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:26.820256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab398-90ff-40c0-bf2f-31a0cef3d9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:26.831676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab398-90ff-40c0-bf2f-31a0cef3d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:26.831676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab398-90ff-40c0-bf2f-31a0cef3d9b2 admin admin] PATH_INFO: `/v3/projects/801a935cf93845cfa20fa5ee70a16372/users/14b08e26bd3c48799cebcdfa5e3b89e1/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:26.917788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab398-90ff-40c0-bf2f-31a0cef3d9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801a935cf93845cfa20fa5ee70a16372, user_id=14b08e26bd3c48799cebcdfa5e3b89e1, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:26.923415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab398-90ff-40c0-bf2f-31a0cef3d9b2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:27.024868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1132/2301] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:26 2022] PUT /identity/v3/projects/801a935cf93845cfa20fa5ee70a16372/users/14b08e26bd3c48799cebcdfa5e3b89e1/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:27.035465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bddde-ad61-4da4-b8dd-4d743d577436 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:27.037897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:27.038412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:27.039122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:27.072246 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:27.120173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] MFA Rules not processed for user `14b08e26bd3c48799cebcdfa5e3b89e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:27.122050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:27.156049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:27.156901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:27.157351 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:27.157781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:27.267332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:27.298542 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:27.307926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:27.317772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1133/2302] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:27.318930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:27.352823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1170/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:27.360256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5174c-cb7f-4d89-b655-0db5b548756c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:27.389610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:27.390462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:27.390953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:27.391521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:27.393545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:27.401956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:27.574136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1134/2304] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:27 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:27.578626 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:27.591750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c749b-2054-4bb8-bf5a-ccf40d653bc7 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:27.813194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:27.813987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:27.815043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:27.816019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:27.817544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:27.842695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:27.967772 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1171/2305] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:27 2022] POST /identity/v3/users => generated 290 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:27.971776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:27.984966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d31ca-ff72-44ad-8f35-39fdda7e76bc admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:27.990988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:27.991690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:27.991971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:27.992253 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:27.992976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:27.994612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:28.007447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1135/2306] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:28.012599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:28.031636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f3b1-3937-4f7d-836d-ad4fa10dcd72 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:28.037874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:28.039340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:28.040458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:28.041141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] PATH_INFO: `/v3/projects/3133d6d77b364e5ba928189f1efa0e47/users/7a322e2b15034d98806516afdbf348f0/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:28.117047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3133d6d77b364e5ba928189f1efa0e47, user_id=7a322e2b15034d98806516afdbf348f0, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:28.120958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:28.327195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:28.330441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:28.333970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1172/2307] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:28 2022] PUT /identity/v3/projects/3133d6d77b364e5ba928189f1efa0e47/users/7a322e2b15034d98806516afdbf348f0/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:28.338040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:28.370881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a6b0-c7c7-444a-b078-52a49c7f11ab admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:28.431109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:28.490334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e92f0-5fcd-4308-aad5-d68d718434a6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:28.494065 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:28.495446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:28.495916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:28.496303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] PATH_INFO: `/v3/projects/492b36d9fa4745e8b9d99c21b97b0e5c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:28.497304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:28.498200 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:28.498799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492b36d9fa4745e8b9d99c21b97b0e5c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:28.498962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:28.499455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:28.500596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:28.501672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:28.503490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:28.520652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1173/2308] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:28.525404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:28.548293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81f22d-bf9a-4f24-a6e9-c52135c79f78 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:28.555145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e4654-d027-4fbf-aaf2-cdbbdefe7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:28.563076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e4654-d027-4fbf-aaf2-cdbbdefe7001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:28.563076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e4654-d027-4fbf-aaf2-cdbbdefe7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:28.563076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e4654-d027-4fbf-aaf2-cdbbdefe7001 admin admin] PATH_INFO: `/v3/projects/3133d6d77b364e5ba928189f1efa0e47/users/7a322e2b15034d98806516afdbf348f0/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:28.563076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e4654-d027-4fbf-aaf2-cdbbdefe7001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3133d6d77b364e5ba928189f1efa0e47, user_id=7a322e2b15034d98806516afdbf348f0, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:28.563076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e4654-d027-4fbf-aaf2-cdbbdefe7001 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:28.585180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1174/2309] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:28 2022] PUT /identity/v3/projects/3133d6d77b364e5ba928189f1efa0e47/users/7a322e2b15034d98806516afdbf348f0/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:28.586919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:28.587213 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:28.587523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:28.678729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492b36d9fa4745e8b9d99c21b97b0e5c', 'request_id': 'req-b1d39608-5441-4a86-abb6-b718e382c986'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:28.704038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492b36d9fa4745e8b9d99c21b97b0e5c', 'request_id': 'req-b1d39608-5441-4a86-abb6-b718e382c986'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:28.713463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] MFA Rules not processed for user `7a322e2b15034d98806516afdbf348f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:28.717661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:28.874669 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1175/2310] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:28.889663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:28.894060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:29.019635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1e1a-81ee-4a25-8de8-f88bed6ce1f9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:29.024756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8086-9c36-4465-bcb0-e3cd4ebf1798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:29.025741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8086-9c36-4465-bcb0-e3cd4ebf1798 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.026094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8086-9c36-4465-bcb0-e3cd4ebf1798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.026382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8086-9c36-4465-bcb0-e3cd4ebf1798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.037423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c8086-9c36-4465-bcb0-e3cd4ebf1798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:29.039155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c8086-9c36-4465-bcb0-e3cd4ebf1798 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:29.057724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492b36d9fa4745e8b9d99c21b97b0e5c', 'request_id': 'req-b1d39608-5441-4a86-abb6-b718e382c986'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:29.071818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] The token cache is being invalidate because project 492b36d9fa4745e8b9d99c21b97b0e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:29.072215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:29.074540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b1d39608-5441-4a86-abb6-b718e382c986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:29.076833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1176/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:29.077060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1136/2312] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:28 2022] DELETE /identity/v3/projects/492b36d9fa4745e8b9d99c21b97b0e5c => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:29.082167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.082521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.088267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.118248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:29.120043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:29.214791 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:29.269723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1177/2313] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:29.271463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.271965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.272409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.313333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:29.316259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:29.337984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1137/2314] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:29.342203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:29.367266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0d688-3c78-47d4-a881-054c471b983c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:29.382625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:29.383353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.385205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.385205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.396199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:29.397767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:29.400795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:29.401217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:29.402957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:29.435519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e939e-5eaf-44a9-ba84-91b433e0b437 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:29.447746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:29.448426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.448717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.448995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.459777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1178/2315] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:13:29.460726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:29.462632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:29.497760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726ade-0397-4ad7-8323-e117449df74f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:29.506473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:29.507843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.508670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.509111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.509966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:29.512784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:29.604646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:29.620735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1179/2316] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:29 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:29.624677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:29.666855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:29.688217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:29.704209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1138/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:29.835888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73481c31-d7c4-4f6e-8f51-e51aca63e4f1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:29.865158 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:29.865877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:29.866160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:29.866437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:29.867136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:29.872563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:30.069711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:30.070251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1180/2318] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:29 2022] POST /identity/v3/users => generated 292 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:30.093810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e30cf-79a5-4a9a-8cbe-3b1d4c8541c8 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:30.119925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:30.122053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:30.128575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:30.128575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:30.128575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:30.130737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:30.179554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1139/2319] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:30.183764 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:30.206786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881aa6-b5a8-4aa5-aaff-5ea971cd9296 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:30.221568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499330c3-d081-41d7-bead-a8d72c9b9ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:30.226131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499330c3-d081-41d7-bead-a8d72c9b9ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:30.226131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499330c3-d081-41d7-bead-a8d72c9b9ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:30.226131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499330c3-d081-41d7-bead-a8d72c9b9ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:30.226131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499330c3-d081-41d7-bead-a8d72c9b9ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:30.226131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499330c3-d081-41d7-bead-a8d72c9b9ee8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:30.267991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:30.270064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1181/2320] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:30.285352 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b443b13-7445-4c7c-a149-78e21495aaf9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:30.335138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:30.340976 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:30.345602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:30.345895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] PATH_INFO: `/v3/projects/eb2c902507914576a1d06ba54a87df1d/users/12293a5616e2410fb173a0b4424e63ff/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:30.408406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c902507914576a1d06ba54a87df1d, user_id=12293a5616e2410fb173a0b4424e63ff, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:30.420032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:30.494770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1140/2321] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:30 2022] PUT /identity/v3/projects/eb2c902507914576a1d06ba54a87df1d/users/12293a5616e2410fb173a0b4424e63ff/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:30.505072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:30.505444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:30.505924 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:30.571354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:30.575397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:30.754229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1182/2322] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:30.771482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:30.776466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:30.896736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98dbfe-11c2-467e-8651-2d2dd52d00a8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:30.901943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a416-87bf-4296-99c7-361e6c0efab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:30.902617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a416-87bf-4296-99c7-361e6c0efab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:30.902903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a416-87bf-4296-99c7-361e6c0efab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:30.903181 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a416-87bf-4296-99c7-361e6c0efab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:30.932100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a416-87bf-4296-99c7-361e6c0efab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:30.934459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a416-87bf-4296-99c7-361e6c0efab9 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:30.970724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1141/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:39.087757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:39.093546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:39.110483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda70785-9d8c-4756-bd8e-cb29fcd739e7 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:39.124802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:39.125716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:39.125997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:39.126274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] PATH_INFO: `/v3/users/14b08e26bd3c48799cebcdfa5e3b89e1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:39.127531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b08e26bd3c48799cebcdfa5e3b89e1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:39.134947 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:39.309164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:39.432775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b08e26bd3c48799cebcdfa5e3b89e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:39.459107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b08e26bd3c48799cebcdfa5e3b89e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:39.467286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b08e26bd3c48799cebcdfa5e3b89e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:39.468153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b08e26bd3c48799cebcdfa5e3b89e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:39.537904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b08e26bd3c48799cebcdfa5e3b89e1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:40.279745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1183/2324] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:39 2022] DELETE /identity/v3/users/14b08e26bd3c48799cebcdfa5e3b89e1 => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:40.286984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fd86e-c194-4389-89d5-fcce40a7f126 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:40.287632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fd86e-c194-4389-89d5-fcce40a7f126 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:40.287913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fd86e-c194-4389-89d5-fcce40a7f126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:40.312262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-543fd86e-c194-4389-89d5-fcce40a7f126 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:40.313612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-543fd86e-c194-4389-89d5-fcce40a7f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:40.397406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1142/2325] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:40.424521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:40.431919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:40.543721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb00a5-8c14-47df-a8ff-754838a38474 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:40.553382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c76c1b-f902-41a8-b399-314f3f33cb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:40.554724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76c1b-f902-41a8-b399-314f3f33cb70 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:40.555337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76c1b-f902-41a8-b399-314f3f33cb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:40.556398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76c1b-f902-41a8-b399-314f3f33cb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:40.593914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c76c1b-f902-41a8-b399-314f3f33cb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:40.599341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c76c1b-f902-41a8-b399-314f3f33cb70 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:40.628807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1184/2326] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:42.381749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267d59d-8a0d-4fc3-89d4-f47246688309 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:42.384500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267d59d-8a0d-4fc3-89d4-f47246688309 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:42.384500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267d59d-8a0d-4fc3-89d4-f47246688309 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:42.386875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1143/2327] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:13:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:13:42.413665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:42.415583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:42.415583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:42.489054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267d59d-8a0d-4fc3-89d4-f47246688309 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:42.491363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c267d59d-8a0d-4fc3-89d4-f47246688309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:42.551875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267d59d-8a0d-4fc3-89d4-f47246688309 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:42.572126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:42.573718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:42.574112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:42.574495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] PATH_INFO: `/v3/users/08ae587bdfdb4dcfa34ca7d128393ffb` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:42.576259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ae587bdfdb4dcfa34ca7d128393ffb)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:42.579052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:42.602699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] MFA Rules not processed for user `db6adef34dc34d9e8b67547fe54ecf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:42.604244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:42.842777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1185/2328] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:13:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:42.843956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:42.847476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:42.890986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:42.899098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ae587bdfdb4dcfa34ca7d128393ffb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:42.912858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ae587bdfdb4dcfa34ca7d128393ffb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:42.917288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ae587bdfdb4dcfa34ca7d128393ffb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:42.917288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ae587bdfdb4dcfa34ca7d128393ffb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:42.956519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ae587bdfdb4dcfa34ca7d128393ffb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:42.966483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4e01-7a56-4b71-b7a4-43b980f00af3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:42.983388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:42.986160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:42.986160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:42.986160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] PATH_INFO: `/v3/projects/801a935cf93845cfa20fa5ee70a16372` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:42.986160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] RBAC: Authorizing `identity:delete_project(project_id=801a935cf93845cfa20fa5ee70a16372)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:42.988629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:42.995162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:43.076711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1144/2329] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:42 2022] DELETE /identity/v3/users/08ae587bdfdb4dcfa34ca7d128393ffb => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:43.078785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:43.080371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:43.157709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801a935cf93845cfa20fa5ee70a16372', 'request_id': 'req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.181281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801a935cf93845cfa20fa5ee70a16372', 'request_id': 'req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.280600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801a935cf93845cfa20fa5ee70a16372', 'request_id': 'req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.294707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a1b57-dcec-450d-92c8-ad9b3e4fc498 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:43.312235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] The token cache is being invalidate because project 801a935cf93845cfa20fa5ee70a16372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:43.312235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.312235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.312235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1186/2330] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:42 2022] DELETE /identity/v3/projects/801a935cf93845cfa20fa5ee70a16372 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:43.317891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:43.320454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:43.416767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:43.417539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:43.417900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:43.418243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:43.421943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:43.437591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:43.439603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:43.452700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1145/2331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:43.480694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918bb62-2ad3-4b0c-b4cc-39d43d9e273e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:43.486037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:43.487169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:43.487581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:43.488663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] PATH_INFO: `/v3/users/7a322e2b15034d98806516afdbf348f0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:43.490393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a322e2b15034d98806516afdbf348f0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:43.492819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:43.595035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:43.600496 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:43.660891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4513a7-c093-40fb-8534-a80861068da7 service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:43.676031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:43.677139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:43.677428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:43.677707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] PATH_INFO: `/v3/projects/1b105397e253414e8ba5124358a29ac5` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:43.680057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b105397e253414e8ba5124358a29ac5)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:43.683691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:43.803547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a322e2b15034d98806516afdbf348f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.819511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a322e2b15034d98806516afdbf348f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.820454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a322e2b15034d98806516afdbf348f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.821372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a322e2b15034d98806516afdbf348f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.863645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a322e2b15034d98806516afdbf348f0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.899711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:43.904439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b105397e253414e8ba5124358a29ac5', 'request_id': 'req-6a3e59e6-cf91-4b5d-af37-2e734cec6181'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.924225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b105397e253414e8ba5124358a29ac5', 'request_id': 'req-6a3e59e6-cf91-4b5d-af37-2e734cec6181'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:43.954442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1187/2332] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:43 2022] DELETE /identity/v3/users/7a322e2b15034d98806516afdbf348f0 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:44.020009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b105397e253414e8ba5124358a29ac5', 'request_id': 'req-6a3e59e6-cf91-4b5d-af37-2e734cec6181'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.041257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] The token cache is being invalidate because project 1b105397e253414e8ba5124358a29ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:44.044199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.048343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-6a3e59e6-cf91-4b5d-af37-2e734cec6181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.056388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1146/2333] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:43 2022] DELETE /identity/v3/projects/1b105397e253414e8ba5124358a29ac5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:44.060083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:44.061950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:44.093699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:44.231173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2b7a-77b3-4d44-9788-be14b6330cf5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:44.251280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:44.252437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:44.252910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:44.253353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] PATH_INFO: `/v3/users/e2ebe3d44b064f3884b8d4237e618fbb` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:44.255717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ebe3d44b064f3884b8d4237e618fbb)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:44.257770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:44.510540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:44.511578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:44.512342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:44.532870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ebe3d44b064f3884b8d4237e618fbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.551826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ebe3d44b064f3884b8d4237e618fbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.554265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ebe3d44b064f3884b8d4237e618fbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.557490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ebe3d44b064f3884b8d4237e618fbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.557858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] MFA Rules not processed for user `12293a5616e2410fb173a0b4424e63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:44.559706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:44.587732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ebe3d44b064f3884b8d4237e618fbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:44.643059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1147/2334] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:44.647706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:44.649874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:44.681542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cedb9d-3e88-4448-96ce-ed5266b00412 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:44.689896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:44.690514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:44.691652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:44.692643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:44.693629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:44.698379 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:44.705032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1188/2335] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:44 2022] DELETE /identity/v3/users/e2ebe3d44b064f3884b8d4237e618fbb => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:44.830504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1148/2336] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:44 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:44.834877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:44.960171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:44.961971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:44.998258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51d10-1a5c-4bde-9b98-421b1f462ded admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:45.101332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:45.117668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a557-6d17-462f-8bdb-d7dc0cee2640 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:45.127475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:45.127475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.127475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.127475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] PATH_INFO: `/v3/projects/3133d6d77b364e5ba928189f1efa0e47` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.129343 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3133d6d77b364e5ba928189f1efa0e47)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:45.131493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:45.183224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:45.184338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.184523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.184944 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.185765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:45.188149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:45.281158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:45.286877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3133d6d77b364e5ba928189f1efa0e47', 'request_id': 'req-af36bddf-fdbf-4977-b4a1-d1e7baa20030'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.295192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3133d6d77b364e5ba928189f1efa0e47', 'request_id': 'req-af36bddf-fdbf-4977-b4a1-d1e7baa20030'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.299036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1189/2337] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:44 2022] POST /identity/v3/users => generated 299 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:45.300941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:45.304771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:45.319923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b9f77-5c43-42d2-b07b-13695710da08 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:45.393807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3133d6d77b364e5ba928189f1efa0e47', 'request_id': 'req-af36bddf-fdbf-4977-b4a1-d1e7baa20030'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.413415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] The token cache is being invalidate because project 3133d6d77b364e5ba928189f1efa0e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:45.413804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.415591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.418287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1149/2338] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:44 2022] DELETE /identity/v3/projects/3133d6d77b364e5ba928189f1efa0e47 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:45.419272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:45.422614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:45.451348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:45.454011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.454678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.455193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] PATH_INFO: `/v3/projects/c364d14d035743e18999ec2edd4528a1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.457063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c364d14d035743e18999ec2edd4528a1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:45.459402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:45.528318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36bddf-fdbf-4977-b4a1-d1e7baa20030 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:45.534529 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952414ea-56e8-47c2-bc91-51eb393239de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:45.540240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952414ea-56e8-47c2-bc91-51eb393239de admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.540240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952414ea-56e8-47c2-bc91-51eb393239de admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.540240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952414ea-56e8-47c2-bc91-51eb393239de admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.540240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952414ea-56e8-47c2-bc91-51eb393239de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:45.540240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952414ea-56e8-47c2-bc91-51eb393239de admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:45.552357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1150/2339] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:45.554068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.554371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.554652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.576408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:45.577875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:45.602448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1151/2340] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:45.602448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:45.626701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c364d14d035743e18999ec2edd4528a1', 'request_id': 'req-ece998b6-d4af-479f-b84f-75b56570779b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.631807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c7630-be8b-4a60-911c-6b65cda53b69 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:45.639109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c364d14d035743e18999ec2edd4528a1', 'request_id': 'req-ece998b6-d4af-479f-b84f-75b56570779b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.741284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:45.741284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.743879 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.748419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] PATH_INFO: `/v3/projects/cca25b196d924e45b54eb31aef4604af/users/db5bfc040fed42c5ae2d73b747c26936/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.763852 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c364d14d035743e18999ec2edd4528a1', 'request_id': 'req-ece998b6-d4af-479f-b84f-75b56570779b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.790068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca25b196d924e45b54eb31aef4604af, user_id=db5bfc040fed42c5ae2d73b747c26936, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:45.793787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:45.796844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] The token cache is being invalidate because project c364d14d035743e18999ec2edd4528a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:45.797370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.825203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ece998b6-d4af-479f-b84f-75b56570779b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:45.834268 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1190/2341] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:45 2022] DELETE /identity/v3/projects/c364d14d035743e18999ec2edd4528a1 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:45.836720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2088e3-001b-477d-993c-ec7a9acc64eb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.837996 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2088e3-001b-477d-993c-ec7a9acc64eb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.839338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2088e3-001b-477d-993c-ec7a9acc64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.879151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ed2088e3-001b-477d-993c-ec7a9acc64eb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:45.880543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ed2088e3-001b-477d-993c-ec7a9acc64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:45.897100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1191/2342] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:45.898828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:45.899211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:45.899597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:45.901900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1152/2343] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:45 2022] PUT /identity/v3/projects/cca25b196d924e45b54eb31aef4604af/users/db5bfc040fed42c5ae2d73b747c26936/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:45.903028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:45.927466 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:45.932261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:45.984112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:46.013948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:46.016648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4b21-c4cc-4144-8f78-59497c60c4af admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.021835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.022598 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.022941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.023248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.024160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:46.024468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.026239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e44b2f-4375-4f84-a4d9-9f405f3d1c85 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.033557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1192/2344] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:46.035220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.036917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:46.044557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1153/2345] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:13:46.046038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.046323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.047078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.056936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67064577-b883-4a65-83e0-20624eed35f3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.063143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.064143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.064629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.065007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.066820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.069239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.070061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:46.071743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:46.084821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1193/2346] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:46.085952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1154/2347] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:46.086654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.088784 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.107413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8065203-6932-49df-b5aa-1a7bbeb6e8cd admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.110757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7ef55-263b-4d14-818c-8fa2891aee93 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.131997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.137758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.139839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.140762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.142484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.143444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.144774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.145169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.145764 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] PATH_INFO: `/v3/projects/cca25b196d924e45b54eb31aef4604af/users/db5bfc040fed42c5ae2d73b747c26936/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.149870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.152991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca25b196d924e45b54eb31aef4604af, user_id=db5bfc040fed42c5ae2d73b747c26936, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.163271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.189038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1155/2348] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:46 2022] PUT /identity/v3/projects/cca25b196d924e45b54eb31aef4604af/users/db5bfc040fed42c5ae2d73b747c26936/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:46.190093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.280081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1194/2349] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:46 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:46.283785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.302215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887906a0-3296-4533-abf6-688c3995cc43 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.382975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694029e-dfd3-45c2-bf96-4329255040c5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.391074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.392361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.393465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.393975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.395923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.399880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.423937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.425296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.426299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.426580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.427468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:46.430719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.430719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.445868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1156/2350] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:13:46.451367 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.467939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3240acb-9a17-4a3e-993f-7b4f48e79683 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.488812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.488812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.488812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.488812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.489242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.489242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.589152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1195/2351] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:46 2022] POST /identity/v3/users => generated 281 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:46.593396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.620713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1157/2352] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:46 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:46.621782 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5d10a-6178-429b-bc72-17b41fa2d23a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.624986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.725311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:46.765942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.766643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.766928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.767205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.768146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.770805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.790405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57990d68-5fa0-4f38-b460-a66472a57152 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.801304 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.802718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.803133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.803742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.804492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1196/2353] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:46.804939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.807722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.808822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.830187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23d2f4-acdf-4503-8192-e44361e2e98a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.844911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.845619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.845921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.846193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.847083 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.848813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.883287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1197/2354] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:46.883509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.899975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dc304-6efe-41dd-920b-fe07e9e8e5c5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.904992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1158/2355] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:46 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:46.908881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234dc69-5aee-4738-a3a9-524ab8d02495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.909396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.911169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234dc69-5aee-4738-a3a9-524ab8d02495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.912838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234dc69-5aee-4738-a3a9-524ab8d02495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.913126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234dc69-5aee-4738-a3a9-524ab8d02495 admin admin] PATH_INFO: `/v3/projects/b4789bd9bc4a4835b79f9b6c0899c82f/users/d91b1c7097bb4cddad92b0587487c40d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.924067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d51bf-3e2d-4904-ba7f-c8acef49c69f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:46.934897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:46.935757 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:46.936134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:46.936786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:46.937700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.939843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.947926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234dc69-5aee-4738-a3a9-524ab8d02495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4789bd9bc4a4835b79f9b6c0899c82f, user_id=d91b1c7097bb4cddad92b0587487c40d, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:46.950801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234dc69-5aee-4738-a3a9-524ab8d02495 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:46.959301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1159/2356] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:46.963077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:46.973593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f2a0-0d3d-4048-a255-61f53243cdab admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:47.001973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:47.002914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.005138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.005637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.006382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:47.008179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:47.020526 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1160/2357] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:47.024200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:47.038058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb0f09-1247-4420-a29a-75f31e261fb0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:47.048157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2effd-cb72-41b5-b90b-2d91d4b728ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:47.053027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2effd-cb72-41b5-b90b-2d91d4b728ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.053027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2effd-cb72-41b5-b90b-2d91d4b728ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.053027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2effd-cb72-41b5-b90b-2d91d4b728ce admin admin] PATH_INFO: `/v3/projects/746e5274e5ef43e4a81475e89702caaa/users/22b6c976722146bfb3a277a03c1d9ca8/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.080866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2effd-cb72-41b5-b90b-2d91d4b728ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=746e5274e5ef43e4a81475e89702caaa, user_id=22b6c976722146bfb3a277a03c1d9ca8, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:47.082491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1198/2358] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:46 2022] PUT /identity/v3/projects/b4789bd9bc4a4835b79f9b6c0899c82f/users/d91b1c7097bb4cddad92b0587487c40d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:47.106003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2effd-cb72-41b5-b90b-2d91d4b728ce admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:47.153157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.154050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.154530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.206438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1161/2359] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:47 2022] PUT /identity/v3/projects/746e5274e5ef43e4a81475e89702caaa/users/22b6c976722146bfb3a277a03c1d9ca8/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:47.208140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.208923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.208923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.224050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:47.242712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] MFA Rules not processed for user `22b6c976722146bfb3a277a03c1d9ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:47.244488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:47.245198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] MFA Rules not processed for user `d91b1c7097bb4cddad92b0587487c40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:47.247955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:47.398354 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1162/2360] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:47.403104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:47.485633 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1199/2361] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:47.531989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:47.535749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:47.584921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4d194-7cfd-41d5-94b5-4e12d72c0690 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:47.590508 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:47.591142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.591556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.592918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.593349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:47.596015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:47.725222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49114ef1-59e7-4d11-a186-d08ab317ec38 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:47.730512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:47.731617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:47.732364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.732657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.733043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.739273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1163/2362] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:47 2022] POST /identity/v3/projects => generated 383 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:47.744837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:47.745027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:47.747987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:47.763677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1200/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:47.782325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:47.796674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000915-4271-4d61-85bc-e3a4f86114d3 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:47.908827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:47.909228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd928d-0ad4-464a-80bd-20b857e51a2e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:47.911144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.912758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.913143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] PATH_INFO: `/v3/users/d91b1c7097bb4cddad92b0587487c40d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.916024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91b1c7097bb4cddad92b0587487c40d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:47.916476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:47.917362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:47.917806 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:47.918274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:47.919728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:47.922117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:47.922557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.014180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:48.019664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1164/2364] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:47 2022] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:48.023774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:48.043402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38d2be-9b6a-4c3f-be85-64a9a131b221 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:48.048682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:48.049571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.049807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.050150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.051120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:48.052800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.064790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1165/2365] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:48.069460 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:48.084280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fe9d2-9ec7-4069-b0f0-3d32c3d31c56 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:48.089537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:48.090517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.090884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.091222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] PATH_INFO: `/v3/projects/5b07405a849b4267a6a39101ae51a539/users/b00faff9b11e4fe4b9385db549792c8b/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.109006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b07405a849b4267a6a39101ae51a539, user_id=b00faff9b11e4fe4b9385db549792c8b, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:48.111922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.248277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1166/2366] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:48 2022] PUT /identity/v3/projects/5b07405a849b4267a6a39101ae51a539/users/b00faff9b11e4fe4b9385db549792c8b/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:48.252986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:48.267738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91b1c7097bb4cddad92b0587487c40d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:48.275942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91b1c7097bb4cddad92b0587487c40d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:48.276983 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91b1c7097bb4cddad92b0587487c40d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:48.277620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91b1c7097bb4cddad92b0587487c40d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:48.293757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8ce74a39-5254-4bb8-a1de-603ad9efa1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91b1c7097bb4cddad92b0587487c40d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:48.381202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3a02-4043-41e0-8580-6b2960b13d88 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:48.390176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:48.390943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.391336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.391852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.392652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:48.395019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.408965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1167/2367] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:48.425490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:48.427505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:48.452060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7feddf-a5f7-418a-a42f-0e0e5cd21237 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:48.460981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1573cc9-c7de-49e2-8f0e-5d63007fd594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:48.462363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1573cc9-c7de-49e2-8f0e-5d63007fd594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.462656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1573cc9-c7de-49e2-8f0e-5d63007fd594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.462981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1573cc9-c7de-49e2-8f0e-5d63007fd594 admin admin] PATH_INFO: `/v3/projects/5b07405a849b4267a6a39101ae51a539/users/b00faff9b11e4fe4b9385db549792c8b/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.465793 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1573cc9-c7de-49e2-8f0e-5d63007fd594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b07405a849b4267a6a39101ae51a539, user_id=b00faff9b11e4fe4b9385db549792c8b, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:48.468682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1573cc9-c7de-49e2-8f0e-5d63007fd594 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.472412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1201/2368] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:47 2022] DELETE /identity/v3/users/d91b1c7097bb4cddad92b0587487c40d => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:48.476678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.477157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.477467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.492492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1168/2369] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:48 2022] PUT /identity/v3/projects/5b07405a849b4267a6a39101ae51a539/users/b00faff9b11e4fe4b9385db549792c8b/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:48.509837 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.510138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.510446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.514529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:48.515731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:48.545852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] MFA Rules not processed for user `b00faff9b11e4fe4b9385db549792c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:48.548738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:48.592240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:48.634524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1202/2370] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:48.653956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:48.655657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:48.662266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1169/2371] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:48.676446 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:48.679775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:48.725522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6b76e-6f36-4ab3-b766-e824a85bbe92 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:48.729313 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:48.730006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.730294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.730696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.757570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:48.758530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.768542 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb548d3-6cf0-490d-8852-940601507320 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:48.775035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:48.785545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:48.785545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:48.785545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:48.785545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:48.785910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1203/2372] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:48.874432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:48.876121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23856f9-272a-4a45-94af-3848ebe3f27a service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:48.886600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1170/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:49.353099 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:49.355010 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:49.384223 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e4f3-86f1-4355-93c9-ab8b52e4d62c service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:49.394855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:49.395800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:49.396082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:49.396396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] PATH_INFO: `/v3/projects/b4789bd9bc4a4835b79f9b6c0899c82f` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:49.400637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4789bd9bc4a4835b79f9b6c0899c82f)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:49.405164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:49.519728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:49.520275 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:49.520786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:49.542847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:49.544218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:49.628613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:49.665325 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4789bd9bc4a4835b79f9b6c0899c82f', 'request_id': 'req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:49.678221 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4789bd9bc4a4835b79f9b6c0899c82f', 'request_id': 'req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:49.739333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1171/2374] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:49.753013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:49.753638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4789bd9bc4a4835b79f9b6c0899c82f', 'request_id': 'req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:49.754590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:49.767261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] The token cache is being invalidate because project b4789bd9bc4a4835b79f9b6c0899c82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:49.767576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:49.771298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c47db8cc-51d5-43d2-9563-0fd64e1d45c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:49.773202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1204/2375] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:49 2022] DELETE /identity/v3/projects/b4789bd9bc4a4835b79f9b6c0899c82f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:49.774548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dddf0b-a92c-473f-8e94-57fc2dcf6569 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:49.775035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dddf0b-a92c-473f-8e94-57fc2dcf6569 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:49.775535 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dddf0b-a92c-473f-8e94-57fc2dcf6569 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:49.777287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1205/2376] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:13:49.778469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:49.779089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc271-76e8-419b-9065-efa2356d49e0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:49.779545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc271-76e8-419b-9065-efa2356d49e0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:49.779997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc271-76e8-419b-9065-efa2356d49e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:49.832149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-2c1cc271-76e8-419b-9065-efa2356d49e0 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:49.843059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2c1cc271-76e8-419b-9065-efa2356d49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:49.923118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134b835-3864-48d4-8855-129ad33fcc34 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:49.944374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1206/2377] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:49.946092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa206d-a611-478d-86a6-9f4ae742dae8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:49.946350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa206d-a611-478d-86a6-9f4ae742dae8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:49.946788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa206d-a611-478d-86a6-9f4ae742dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.002366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bbaa206d-a611-478d-86a6-9f4ae742dae8 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:50.004141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bbaa206d-a611-478d-86a6-9f4ae742dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.081830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.082646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.083037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.083873 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.085770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.142547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1207/2378] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:13:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:50.149381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.149678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.150116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.167818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.170523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.176328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:50.177755 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.180648 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1172/2379] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:13:50.185061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.185061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.196608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1208/2380] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:50.200627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.211019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694e958-d705-4500-b142-dbc626f229c8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.223129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.223841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.224128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.224404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.225143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:50.225451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.240066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.258593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cff5f-4e68-4838-b1ba-20920203bad3 service swift] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.263563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.264235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.264574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.264898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.265405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1209/2381] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:13:50.270421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.281599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.283184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.291960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:50.294928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9224b-f804-4ded-8c43-87c8c5f2b508 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.298702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1173/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:50.300435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731022c-0974-4ddf-80ca-e62609875740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.301227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731022c-0974-4ddf-80ca-e62609875740 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.301534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731022c-0974-4ddf-80ca-e62609875740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.301812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731022c-0974-4ddf-80ca-e62609875740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.302593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731022c-0974-4ddf-80ca-e62609875740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.304552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731022c-0974-4ddf-80ca-e62609875740 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.429958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1210/2383] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:50 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:50.434465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.450167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dc82-4923-4966-9ec4-4cafda830ac3 service glance] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.523157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.523920 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.524205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.524484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.525206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.527265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.575162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a5e4-62a9-4a5e-a02d-76a79d97bb34 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.575671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a5e4-62a9-4a5e-a02d-76a79d97bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.577826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a5e4-62a9-4a5e-a02d-76a79d97bb34 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.579536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1211/2384] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:13:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:13:50.585274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.585664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.586038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.612044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:50.613521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.621051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1174/2385] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:50 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:50.622595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.636463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d751c3-04fd-4102-adfd-455a598421ce admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.643273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.644556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.644847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.645120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.645856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.647480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.663998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1175/2386] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:50.665417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.676360 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa781961-057a-4bc0-8f1e-fb18289245cb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.682048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.682968 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.683439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.683711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.684468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.686244 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.692428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1212/2387] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:50.700552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.700942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1176/2388] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:50.702421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.704808 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:50.718583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e40dc-7b5f-4aa9-8964-0a5d4a0432df None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.721364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d120-935c-4009-a47b-2080a56e6de8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:50.724056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979521db-17b0-4327-90c3-d64def4f7bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.724896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979521db-17b0-4327-90c3-d64def4f7bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.725420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979521db-17b0-4327-90c3-d64def4f7bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.725842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979521db-17b0-4327-90c3-d64def4f7bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.726049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7646a49-11da-46a6-a6ca-4900374b3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:50.726986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7646a49-11da-46a6-a6ca-4900374b3569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.727413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7646a49-11da-46a6-a6ca-4900374b3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.727960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7646a49-11da-46a6-a6ca-4900374b3569 admin admin] PATH_INFO: `/v3/projects/7b2462901a174e2d9a659456fb8badc4/users/5b2b1c1317d445fab58a00a246c08bc5/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.735216 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979521db-17b0-4327-90c3-d64def4f7bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.736912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979521db-17b0-4327-90c3-d64def4f7bd2 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.746900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7646a49-11da-46a6-a6ca-4900374b3569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2462901a174e2d9a659456fb8badc4, user_id=5b2b1c1317d445fab58a00a246c08bc5, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:50.753842 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7646a49-11da-46a6-a6ca-4900374b3569 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:50.758937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1213/2389] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:50.845584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:50.853058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1177/2390] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:50 2022] PUT /identity/v3/projects/7b2462901a174e2d9a659456fb8badc4/users/5b2b1c1317d445fab58a00a246c08bc5/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:50.864381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.864956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.865393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.897319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786dab-b361-4be8-85a0-720da0fe1ed8 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.897774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786dab-b361-4be8-85a0-720da0fe1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.898306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786dab-b361-4be8-85a0-720da0fe1ed8 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.899954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1178/2391] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:13:50.901811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] MFA Rules not processed for user `5b2b1c1317d445fab58a00a246c08bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:50.904155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:50.911073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:50.911073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:50.911073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:50.948231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:50.949402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:51.059486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1214/2392] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:51.064858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:51.101715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1179/2393] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:51.113729 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:51.190076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:51.205581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d8906-7660-4df0-88cb-4dde413944f8 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:51.212845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:51.213695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:51.214029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:51.214357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:51.215068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:51.216944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84cca0-5eee-4dd0-a1a2-19d7b5dcdff4 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:51.217397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:51.221928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:51.223960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:51.236455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:51.237213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:51.266656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:51.272241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:51.315020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1180/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:13:51.338490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1215/2395] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:51 2022] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:13:51.339597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:51.360760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02588b3-b9e8-4b6a-856f-b8e11f6fc521 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:51.496771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:51.497468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:51.499203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:51.499203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:51.499203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:51.502937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:51.667789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1181/2396] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:51 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:51.668204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:51.672479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:51.699861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e31a9-28d7-48c5-a1fb-4846cc800e43 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:51.711519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:51.713837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:51.715102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:51.725185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:51.726089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:51.732895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:51.761957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1216/2397] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:51.763653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:51.780584 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f06795-40f6-4409-953f-17bd7217d492 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:51.791000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:51.792597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:51.793214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:51.793565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] PATH_INFO: `/v3/projects/4965a9165d4644c7924d2d023fe62dc7/users/a50fb6d5e6f74e5c8319e93d7bb99897/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:51.824470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4965a9165d4644c7924d2d023fe62dc7, user_id=a50fb6d5e6f74e5c8319e93d7bb99897, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:51.835810 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:51.949666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1182/2398] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:51 2022] PUT /identity/v3/projects/4965a9165d4644c7924d2d023fe62dc7/users/a50fb6d5e6f74e5c8319e93d7bb99897/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:51.953429 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:51.977008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae490-3b7d-4fca-b048-f7aa44ea9e55 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:52.061058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ba835-d84b-437a-ab0d-1017a7df318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:52.062748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ba835-d84b-437a-ab0d-1017a7df318f admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:52.063124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ba835-d84b-437a-ab0d-1017a7df318f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:52.063560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ba835-d84b-437a-ab0d-1017a7df318f admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:52.064415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ba835-d84b-437a-ab0d-1017a7df318f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:52.066360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ba835-d84b-437a-ab0d-1017a7df318f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:52.082328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:52.084688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1217/2399] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:52.095027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad3c6a-ee8e-4a88-a0ed-6cf9180cdb1e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:52.100751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:52.101822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:52.102101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:52.102553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] PATH_INFO: `/v3/projects/4965a9165d4644c7924d2d023fe62dc7/users/a50fb6d5e6f74e5c8319e93d7bb99897/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:52.104800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4965a9165d4644c7924d2d023fe62dc7, user_id=a50fb6d5e6f74e5c8319e93d7bb99897, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:52.107817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:52.124243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1183/2400] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:52 2022] PUT /identity/v3/projects/4965a9165d4644c7924d2d023fe62dc7/users/a50fb6d5e6f74e5c8319e93d7bb99897/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:52.130434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9afb-e10c-41cb-9aa8-5ed31bb72dfe None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:52.130726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9afb-e10c-41cb-9aa8-5ed31bb72dfe None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:52.131009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a9afb-e10c-41cb-9aa8-5ed31bb72dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:52.162825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3d0a9afb-e10c-41cb-9aa8-5ed31bb72dfe None None] MFA Rules not processed for user `a50fb6d5e6f74e5c8319e93d7bb99897`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:52.164341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3d0a9afb-e10c-41cb-9aa8-5ed31bb72dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:52.239345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1218/2401] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:52.247623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:52.249913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:52.342033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28b3f4-39fc-44c7-b7f7-33ddf731759d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:52.345845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:52.346798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:52.348198 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:52.348829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:52.431731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:52.450692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:52.452371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:52.463539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1184/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:54.150428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:54.151985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:54.151985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:54.199307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] MFA Rules not processed for user `db5bfc040fed42c5ae2d73b747c26936`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:54.200882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:54.279270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:54.355740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1219/2403] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:54.365157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:54.466443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd89089-6d13-4f32-974c-b05faab05a41 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:54.470157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:54.470828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:54.471134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:54.472573 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:54.476259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:54.543658 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:54.545269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77f55b-4ae9-458b-a873-b5a87644866b service glance] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:54.555174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1185/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:54.572232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:54.574263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:54.641591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b866f85-1d42-4b07-b2c3-f4734d26da25 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:54.646682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:54.647878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:54.647878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:54.648118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] PATH_INFO: `/v3/users/75b429eb57bd41baaa1a0952ca63eeab` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:54.649485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b429eb57bd41baaa1a0952ca63eeab)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:54.651581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:54.851380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:54.851672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:54.851953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:54.869792 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:54.871046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:54.871977 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b429eb57bd41baaa1a0952ca63eeab'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:54.879302 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b429eb57bd41baaa1a0952ca63eeab'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:54.880143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b429eb57bd41baaa1a0952ca63eeab'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:54.880839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b429eb57bd41baaa1a0952ca63eeab'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:54.894570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b429eb57bd41baaa1a0952ca63eeab'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:54.937988 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1186/2405] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:54.950032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:54.951758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:54.971116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1220/2406] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:54 2022] DELETE /identity/v3/users/75b429eb57bd41baaa1a0952ca63eeab => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:55.009641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:55.036775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0119fc9-3de7-4f14-9209-8b12deb5176e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:55.121899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:55.122839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:55.123499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:55.123716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:55.226062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:55.227783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:55.237168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1187/2407] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 09:13:55.272923 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:55.274509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:55.332187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:55.333740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:55.364978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78315f6-1c2a-40d6-9f23-d431f8755afa admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:55.375538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:55.378656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:55.378656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:55.378656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:55.384022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:55.428654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:55.442794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beacc1-6833-44ad-8e61-10ffe1a95196 service swift] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:55.456000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:55.458556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:55.459727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:55.460012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] PATH_INFO: `/v3/projects/f835785be0684dc7a270a89a093e9609` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:55.461470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f835785be0684dc7a270a89a093e9609)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:55.463947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:55.482622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:55.484353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab39550-8255-4181-8f88-017014e5976d service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:55.496867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1221/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:55.576604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:55.603149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f835785be0684dc7a270a89a093e9609', 'request_id': 'req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:55.625393 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f835785be0684dc7a270a89a093e9609', 'request_id': 'req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:55.710761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f835785be0684dc7a270a89a093e9609', 'request_id': 'req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:55.745081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] The token cache is being invalidate because project f835785be0684dc7a270a89a093e9609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:55.745444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:55.746486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:55.753595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1188/2409] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:55 2022] DELETE /identity/v3/projects/f835785be0684dc7a270a89a093e9609 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:55.756228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:55.756390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4158-af44-4cce-8c76-d39ceab044be None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:55.757248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4158-af44-4cce-8c76-d39ceab044be None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:55.757248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4158-af44-4cce-8c76-d39ceab044be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:55.767627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:55.794123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bcfa4158-af44-4cce-8c76-d39ceab044be None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:55.795467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bcfa4158-af44-4cce-8c76-d39ceab044be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:55.903661 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3775583-1fa5-4cd1-9b8e-297396e5c0e3 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:55.912197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:55.913168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:55.913520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:55.913869 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] PATH_INFO: `/v3/users/5b2b1c1317d445fab58a00a246c08bc5` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:55.915227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2b1c1317d445fab58a00a246c08bc5)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:55.917557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:55.959921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1222/2410] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:56.046009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.046624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.047136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.104315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:56.111085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:56.120984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1223/2411] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:56.124869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.138815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a52bf-5200-4b08-a024-ae7c42cc84cf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.144390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.145385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.145678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.146105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.147287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:13:56.147287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.151015 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.166050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1224/2412] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:13:56.171057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.184001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ab70-9e76-45f1-9b9e-6fb8c213fa88 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.185866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2b1c1317d445fab58a00a246c08bc5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:56.189462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.190235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.191401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.191865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.192611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.194637 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.218789 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2b1c1317d445fab58a00a246c08bc5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:56.221241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2b1c1317d445fab58a00a246c08bc5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:56.223102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2b1c1317d445fab58a00a246c08bc5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:56.281740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-87a97761-28d2-438b-b8ee-6cbb7f922b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2b1c1317d445fab58a00a246c08bc5'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:56.309785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1225/2413] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:13:56 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:56.310672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.313008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:56.413500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1189/2414] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:55 2022] DELETE /identity/v3/users/5b2b1c1317d445fab58a00a246c08bc5 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:56.415443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c70d9-4523-48a4-840f-f1d8717d4173 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.431624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c70d9-4523-48a4-840f-f1d8717d4173 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.436947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c70d9-4523-48a4-840f-f1d8717d4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.457758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f972ec-96c4-4a2b-9619-443fc94adf93 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.504421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-277c70d9-4523-48a4-840f-f1d8717d4173 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:56.514444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-277c70d9-4523-48a4-840f-f1d8717d4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:56.522235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:56.609839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:56.625425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.626214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.626500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.626773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.628956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.634198 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.678610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1190/2415] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:56.678610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.678610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.678610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.714769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:56.717492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:56.752551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1191/2416] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:13:56.753957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.754725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1226/2417] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:13:56 2022] POST /identity/v3/users => generated 287 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:13:56.761893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.769992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:56.782472 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eadd8-c16f-4a53-bc28-f41d04d9bbdc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.792724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.793432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.793694 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.794428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.794714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.796374 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.819260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1227/2418] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:13:56.820251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.832553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:56.902524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dfed9-6fcc-4dfc-b725-3d394443cae6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.909965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.911128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.912042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.912838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.927386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.929019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.937424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c037f-6812-438d-a8d7-ef40ebb50c75 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.944992 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1228/2419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:56.945776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:56.956209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a70fa4-7f80-49e6-90e9-553500e5858a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.956452 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dd087-e9ec-4b4d-88d0-042a19f53a0f service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:56.957153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a70fa4-7f80-49e6-90e9-553500e5858a service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.957568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a70fa4-7f80-49e6-90e9-553500e5858a service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.957955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a70fa4-7f80-49e6-90e9-553500e5858a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.963776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:56.965062 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:56.965437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:56.965722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:56.966467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.968126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.985653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a70fa4-7f80-49e6-90e9-553500e5858a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:56.985859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1229/2420] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:13:56.985951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a70fa4-7f80-49e6-90e9-553500e5858a service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:56.989538 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:57.002732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1192/2421] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:13:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:13:57.003603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14601233-24f9-48d2-af4e-77700386dd78 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:57.034270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:57.035290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:57.035570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:57.035845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] PATH_INFO: `/v3/projects/ca3cf0a7b9b0463cb4c0ef30736fa74d/users/3811f629778f4154a2e2eff9a58619c3/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:57.084040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3cf0a7b9b0463cb4c0ef30736fa74d, user_id=3811f629778f4154a2e2eff9a58619c3, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:57.091030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:57.250523 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1230/2422] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:13:56 2022] PUT /identity/v3/projects/ca3cf0a7b9b0463cb4c0ef30736fa74d/users/3811f629778f4154a2e2eff9a58619c3/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:13:57.261278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:57.261581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:57.262188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:57.337482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] MFA Rules not processed for user `3811f629778f4154a2e2eff9a58619c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:13:57.338799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:57.586580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1193/2423] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:13:57.594608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:57.597486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:57.733477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6a90e-703f-42f6-a6de-31e20996d8c9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:57.738702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:57.739590 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:57.739944 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:57.740667 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:57.784954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:57.786747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:13:57.809432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:57.815209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:57.856405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1231/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:13:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:13:58.022154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:58.037635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50252bf-76f9-44eb-a5d1-1a14c95ef565 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:58.086263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:58.094639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:58.095086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:58.097897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] PATH_INFO: `/v3/projects/7b2462901a174e2d9a659456fb8badc4` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:58.100957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2462901a174e2d9a659456fb8badc4)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:58.114700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:58.462875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2462901a174e2d9a659456fb8badc4', 'request_id': 'req-a17e0540-7022-4c0e-9bce-070869a8911b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:58.473022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2462901a174e2d9a659456fb8badc4', 'request_id': 'req-a17e0540-7022-4c0e-9bce-070869a8911b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:58.896663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2462901a174e2d9a659456fb8badc4', 'request_id': 'req-a17e0540-7022-4c0e-9bce-070869a8911b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:58.933167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] The token cache is being invalidate because project 7b2462901a174e2d9a659456fb8badc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:13:58.933396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:58.935906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:58.941268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1194/2425] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:13:57 2022] DELETE /identity/v3/projects/7b2462901a174e2d9a659456fb8badc4 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:13:58.946052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:13:58.960301 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce821f-afa2-47b7-bcad-8289ea6878a5 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:13:59.000812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:59.167724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:13:59.176773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:13:59.177232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:13:59.180995 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] PATH_INFO: `/v3/users/a50fb6d5e6f74e5c8319e93d7bb99897` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:13:59.182972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50fb6d5e6f74e5c8319e93d7bb99897)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:13:59.185326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:13:59.436467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50fb6d5e6f74e5c8319e93d7bb99897'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:59.457991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50fb6d5e6f74e5c8319e93d7bb99897'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:59.473943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50fb6d5e6f74e5c8319e93d7bb99897'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:59.475666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50fb6d5e6f74e5c8319e93d7bb99897'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:59.520731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-11576dd1-5458-4f9d-a8bf-9ae764287b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50fb6d5e6f74e5c8319e93d7bb99897'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:13:59.654646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1232/2426] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:13:58 2022] DELETE /identity/v3/users/a50fb6d5e6f74e5c8319e93d7bb99897 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:00.349724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:00.351375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:00.385407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e0540-7022-4c0e-9bce-070869a8911b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:00.504484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:00.505376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:00.508162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:00.508162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] PATH_INFO: `/v3/projects/4965a9165d4644c7924d2d023fe62dc7` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:00.508162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4965a9165d4644c7924d2d023fe62dc7)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:00.513424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:00.706956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4965a9165d4644c7924d2d023fe62dc7', 'request_id': 'req-99478192-faf5-4b03-b07d-ee1eb62d69b8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:00.719621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4965a9165d4644c7924d2d023fe62dc7', 'request_id': 'req-99478192-faf5-4b03-b07d-ee1eb62d69b8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:00.788505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e896-533d-4360-8ee7-bfafa97f251a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:00.788505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e896-533d-4360-8ee7-bfafa97f251a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:00.788505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e896-533d-4360-8ee7-bfafa97f251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:00.804684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4965a9165d4644c7924d2d023fe62dc7', 'request_id': 'req-99478192-faf5-4b03-b07d-ee1eb62d69b8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:00.832905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-17a9e896-533d-4360-8ee7-bfafa97f251a None None] MFA Rules not processed for user `3811f629778f4154a2e2eff9a58619c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:00.834144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-17a9e896-533d-4360-8ee7-bfafa97f251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:00.835335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] The token cache is being invalidate because project 4965a9165d4644c7924d2d023fe62dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:14:00.836733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:00.837811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:00.844937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1195/2427] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:14:00 2022] DELETE /identity/v3/projects/4965a9165d4644c7924d2d023fe62dc7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:01.084629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1233/2428] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:14:04.681472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:04.682942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:04.724492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:04.805113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478192-faf5-4b03-b07d-ee1eb62d69b8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:04.811482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:04.812644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:04.813100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:04.813591 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] PATH_INFO: `/v3/users/22b6c976722146bfb3a277a03c1d9ca8` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:04.815043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b6c976722146bfb3a277a03c1d9ca8)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:04.817222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:05.078702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b6c976722146bfb3a277a03c1d9ca8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:05.111414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b6c976722146bfb3a277a03c1d9ca8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:05.115306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b6c976722146bfb3a277a03c1d9ca8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:05.116113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b6c976722146bfb3a277a03c1d9ca8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:05.154132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b6c976722146bfb3a277a03c1d9ca8'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:05.279995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1196/2429] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:14:04 2022] DELETE /identity/v3/users/22b6c976722146bfb3a277a03c1d9ca8 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:05.285383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:05.289433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:05.289433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:05.322709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:05.324353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:05.374744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:05.439945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1234/2430] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:05.450563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:05.455652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:05.545146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce3a69-3ccb-4a8c-937a-bab3802fd0e8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:05.548897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:05.551261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:05.551261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:05.551261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:05.560665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:05.562121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:05.573652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1197/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:14:06.585157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:06.587574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:06.611686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79263979-f3d7-4c87-8b52-ab0982450da1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:06.621675 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:06.622562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:06.622849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:06.623123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] PATH_INFO: `/v3/projects/746e5274e5ef43e4a81475e89702caaa` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:06.624411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746e5274e5ef43e4a81475e89702caaa)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:06.626518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:06.785864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746e5274e5ef43e4a81475e89702caaa', 'request_id': 'req-d04dfb43-2b7a-449a-82d2-a85313c212c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:06.796980 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746e5274e5ef43e4a81475e89702caaa', 'request_id': 'req-d04dfb43-2b7a-449a-82d2-a85313c212c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:06.868948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746e5274e5ef43e4a81475e89702caaa', 'request_id': 'req-d04dfb43-2b7a-449a-82d2-a85313c212c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:06.902734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] The token cache is being invalidate because project 746e5274e5ef43e4a81475e89702caaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:14:06.906350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:06.910264 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:06.917579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1235/2432] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:14:06 2022] DELETE /identity/v3/projects/746e5274e5ef43e4a81475e89702caaa => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:06.918728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:06.931013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939f85b-cbe5-4abb-a50b-62dd57fa2e83 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:07.001030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:07.041118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:07.042615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:07.042851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:07.043128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] PATH_INFO: `/v3/users/b00faff9b11e4fe4b9385db549792c8b` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:07.044975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00faff9b11e4fe4b9385db549792c8b)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:07.048409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:07.335540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00faff9b11e4fe4b9385db549792c8b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:07.344407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00faff9b11e4fe4b9385db549792c8b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:07.346705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00faff9b11e4fe4b9385db549792c8b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:07.347319 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00faff9b11e4fe4b9385db549792c8b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:07.383130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-08f3c44b-d440-4521-b3c2-021822419282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00faff9b11e4fe4b9385db549792c8b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:07.485710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1198/2433] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:14:06 2022] DELETE /identity/v3/users/b00faff9b11e4fe4b9385db549792c8b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:08.111171 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:08.116622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:08.152463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dfb43-2b7a-449a-82d2-a85313c212c8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:08.288261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:08.289165 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:08.289447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:08.289723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] PATH_INFO: `/v3/projects/5b07405a849b4267a6a39101ae51a539` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:08.296148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b07405a849b4267a6a39101ae51a539)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:08.301019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:08.450413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b07405a849b4267a6a39101ae51a539', 'request_id': 'req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:08.457958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b07405a849b4267a6a39101ae51a539', 'request_id': 'req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:08.598969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b07405a849b4267a6a39101ae51a539', 'request_id': 'req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:08.604237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:08.612811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] The token cache is being invalidate because project 5b07405a849b4267a6a39101ae51a539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:14:08.613167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:08.613873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-36ea9f3e-04cd-4c2c-ad2e-69b089e82c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:08.628294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1236/2434] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:14:08 2022] DELETE /identity/v3/projects/5b07405a849b4267a6a39101ae51a539 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:08.636138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:08.637499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:08.637951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:08.659415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:08.661888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:08.735150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1199/2435] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:08.746596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:08.747345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:08.747890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:08.793239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:08.796918 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:08.816663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:08.817473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1237/2436] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:08.831427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d48eb-9302-4ffa-816f-a1438c860b0b None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:08.836329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:08.837200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:08.837510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:08.837797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:08.838478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:14:08.838785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:08.840481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:08.858203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1200/2437] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:14:08.861120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:08.871648 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb5d94-ca86-4ecc-96d3-1e51e9e8b5a1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:08.877175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:08.882770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:08.882770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:08.882770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:08.882770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:08.882770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:08.969713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1238/2438] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:14:08 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:14:08.976349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:08.990512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c238d-2832-47e5-ab67-9f5fe7dcf144 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:09.059098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:09.084711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:09.085362 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.085646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.086017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.086852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:09.088957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:09.213222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1201/2439] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:14:08 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:14:09.220190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:09.251627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ff60-2953-4ded-94fa-366af28dae56 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:09.257526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:09.258220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.258508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.258788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.259702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:09.261347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:09.274861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1239/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:14:09.278779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:09.294830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599096b6-f0b6-4b30-94bf-a287d9e2176f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:09.300732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e9f9-8eb8-4bb0-9d2a-f0a1537d616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:09.303626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e9f9-8eb8-4bb0-9d2a-f0a1537d616c admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.303946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e9f9-8eb8-4bb0-9d2a-f0a1537d616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.304229 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e9f9-8eb8-4bb0-9d2a-f0a1537d616c admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.304981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604e9f9-8eb8-4bb0-9d2a-f0a1537d616c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:09.306633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604e9f9-8eb8-4bb0-9d2a-f0a1537d616c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:09.318462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1202/2441] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:14:09.322799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:09.335187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82675f30-8c8d-49ba-be8f-25cc499a239c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:09.340595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:09.342008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.346823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.346823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] PATH_INFO: `/v3/projects/c5393c21cbc043318c9338c11264d29d/users/dd2ce82718c341e8b1c321a2f128375d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.380386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd9ba4-3ecb-4125-8b22-e3b6cb18c2e4 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.386738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd9ba4-3ecb-4125-8b22-e3b6cb18c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.386738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd9ba4-3ecb-4125-8b22-e3b6cb18c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.396330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5393c21cbc043318c9338c11264d29d, user_id=dd2ce82718c341e8b1c321a2f128375d, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:09.400403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:09.413694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-44cd9ba4-3ecb-4125-8b22-e3b6cb18c2e4 None None] MFA Rules not processed for user `12293a5616e2410fb173a0b4424e63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:09.416670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-44cd9ba4-3ecb-4125-8b22-e3b6cb18c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:09.480931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1203/2442] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:14:09.504389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1240/2443] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:14:09 2022] PUT /identity/v3/projects/c5393c21cbc043318c9338c11264d29d/users/dd2ce82718c341e8b1c321a2f128375d/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:14:09.516574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7e96-874b-455c-a8e8-2d4c624773fe None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.517893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7e96-874b-455c-a8e8-2d4c624773fe None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.518860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7e96-874b-455c-a8e8-2d4c624773fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.538350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-48cd7e96-874b-455c-a8e8-2d4c624773fe None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:09.539651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-48cd7e96-874b-455c-a8e8-2d4c624773fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:09.612672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1204/2444] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:09.622907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:09.625018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:09.686986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a85019-8136-4c78-a10f-9dffcbb92966 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:09.691204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:09.691967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:09.692251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:09.692527 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:09.702885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:09.704403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:09.715888 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1241/2445] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:14:11.057159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:11.057691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:11.057691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:11.106897 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] MFA Rules not processed for user `dd2ce82718c341e8b1c321a2f128375d`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:11.112361 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:11.176967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:11.182199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1205/2446] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:11.194056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:11.195658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:11.255403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de16fe-9e3d-4e80-b841-180e78dcf046 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:11.263748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782886ed-3e63-4404-9055-a467a30e1429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:11.264433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782886ed-3e63-4404-9055-a467a30e1429 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:11.264724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782886ed-3e63-4404-9055-a467a30e1429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:11.265007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782886ed-3e63-4404-9055-a467a30e1429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:11.274146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782886ed-3e63-4404-9055-a467a30e1429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:11.275679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782886ed-3e63-4404-9055-a467a30e1429 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:11.285057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1242/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:14:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:14:11.629954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:11.631533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:11.703762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d4344-a231-4d2c-9879-da90e1ceaa2c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:11.708665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:11.709310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:11.709592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:11.709866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:11.711727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:11.723899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:11.728435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882d95d-bf8a-4a36-b309-8112fcb912d9 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:11.735896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1206/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:14:13.128101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:13.128644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:13.128644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:13.145768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] MFA Rules not processed for user `dd2ce82718c341e8b1c321a2f128375d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:13.146966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:13.153862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1243/2449] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:14.043639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d72b5-f3c4-4c0f-97b2-40e3a4840cf1 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:14.044125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d72b5-f3c4-4c0f-97b2-40e3a4840cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:14.044736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d72b5-f3c4-4c0f-97b2-40e3a4840cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:14.106301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ec4d72b5-f3c4-4c0f-97b2-40e3a4840cf1 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:14.107736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ec4d72b5-f3c4-4c0f-97b2-40e3a4840cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:14.187155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1207/2450] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:14:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:14.199961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:14.201545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:14.237049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:14.323744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33795-53be-4a14-9a04-8d13fb28e1b3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:14.331217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:14.332078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:14.332456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:14.332839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:14.342674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:14.344530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:14.354814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1244/2451] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:14:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:24.183540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=73 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:24.404414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=28 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:30.460098 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06af7-e3d8-4e6a-9825-07a127458430 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:30.460488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06af7-e3d8-4e6a-9825-07a127458430 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:30.460651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06af7-e3d8-4e6a-9825-07a127458430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:30.480013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d3c06af7-e3d8-4e6a-9825-07a127458430 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:30.481458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d3c06af7-e3d8-4e6a-9825-07a127458430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:30.489791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1208/2452] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:30.514509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:30.525676 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187a2eb-178d-46c8-9c1b-b70052717034 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:30.531260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:30.531948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:30.532363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:30.533202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:30.545481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:30.547341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:30.557404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1245/2453] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:40.474466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:40.553928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:42.734216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859daf-4351-4c9a-81fe-b86824401b16 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:42.734686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859daf-4351-4c9a-81fe-b86824401b16 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:42.734807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859daf-4351-4c9a-81fe-b86824401b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:42.753303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d6859daf-4351-4c9a-81fe-b86824401b16 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:42.754571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d6859daf-4351-4c9a-81fe-b86824401b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:42.761964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1209/2454] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:14:42.774148 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:42.785299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161757bb-700a-4df9-830c-bb4b9cd1a090 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:42.790471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:42.791169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:42.791470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:42.791749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:42.799909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:42.801496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:42.809506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1246/2455] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:14:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:43.789278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652ea2-9444-40f6-9715-f43c77fd8307 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:43.789730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652ea2-9444-40f6-9715-f43c77fd8307 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:43.789822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652ea2-9444-40f6-9715-f43c77fd8307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:43.807909 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2a652ea2-9444-40f6-9715-f43c77fd8307 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:43.809086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2a652ea2-9444-40f6-9715-f43c77fd8307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:43.816957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1210/2456] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:43.829655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:43.840295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce52a-6f52-4a1a-99a7-6bfde4ad2da5 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:43.845956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:43.846575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:43.846856 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:43.847132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:43.855102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:43.856683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:43.865243 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1247/2457] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:14:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:44.448301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513ce54-6a54-4120-ab6c-184da8b2ce14 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:44.448596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513ce54-6a54-4120-ab6c-184da8b2ce14 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:44.448910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513ce54-6a54-4120-ab6c-184da8b2ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:44.473829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1513ce54-6a54-4120-ab6c-184da8b2ce14 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:44.475674 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1513ce54-6a54-4120-ab6c-184da8b2ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:44.489266 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1211/2458] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:44.501884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:44.513182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b322-09ab-48ca-8226-290937dce091 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:44.518163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:44.518831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:44.519113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:44.519418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:44.527468 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:44.529036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:44.537112 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1248/2459] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:45.051865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:45.052290 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:45.057600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:45.070000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:45.071199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:45.078346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1212/2460] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:45.092345 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:45.103596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429be0c-3bfc-4067-af9c-6f4ce8937fb6 service swift] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:45.108641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13e4e6-47e1-4bac-a0b3-1843dad643cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:45.109285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13e4e6-47e1-4bac-a0b3-1843dad643cd service swift] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:45.109599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13e4e6-47e1-4bac-a0b3-1843dad643cd service swift] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:45.109885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13e4e6-47e1-4bac-a0b3-1843dad643cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:45.118021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13e4e6-47e1-4bac-a0b3-1843dad643cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:45.119584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13e4e6-47e1-4bac-a0b3-1843dad643cd service swift] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:45.129006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1249/2461] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:14:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:47.774544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:47.776036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:47.790011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e942-76ad-4de8-ae5e-dd68a0f89375 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:47.794490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:47.795390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:47.795680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:47.795986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] PATH_INFO: `/v3/users/3811f629778f4154a2e2eff9a58619c3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:47.797188 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3811f629778f4154a2e2eff9a58619c3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:47.799106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:48.004156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3811f629778f4154a2e2eff9a58619c3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.011840 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3811f629778f4154a2e2eff9a58619c3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.012691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3811f629778f4154a2e2eff9a58619c3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.013312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3811f629778f4154a2e2eff9a58619c3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.026292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3811f629778f4154a2e2eff9a58619c3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.100261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1213/2462] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:14:47 2022] DELETE /identity/v3/users/3811f629778f4154a2e2eff9a58619c3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:48.104875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:48.105347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:48.105465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:48.123748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:14:48.124958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:48.189567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1250/2463] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:14:48.199048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:48.200519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:48.261781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c804c5f-bb37-44e7-8e73-fdb782f027ff admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:48.265378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:48.266012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:48.266294 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:48.266596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:48.275775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:48.277255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:48.286636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1214/2464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:14:48.523700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:48.525132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:48.542750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628cfe0-0e0a-40bb-9b05-d739864d4e5d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:48.549120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:48.550153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:48.550430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:48.550671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] PATH_INFO: `/v3/projects/ca3cf0a7b9b0463cb4c0ef30736fa74d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:48.551876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3cf0a7b9b0463cb4c0ef30736fa74d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:48.553786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:48.664858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'request_id': 'req-b75e4f7f-1c50-4a04-bc82-87c52d259d88'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.670957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'request_id': 'req-b75e4f7f-1c50-4a04-bc82-87c52d259d88'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.739166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'request_id': 'req-b75e4f7f-1c50-4a04-bc82-87c52d259d88'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.750880 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] The token cache is being invalidate because project ca3cf0a7b9b0463cb4c0ef30736fa74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:14:48.751318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.751962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b75e4f7f-1c50-4a04-bc82-87c52d259d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:14:48.753499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1251/2465] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:14:48 2022] DELETE /identity/v3/projects/ca3cf0a7b9b0463cb4c0ef30736fa74d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:14:50.889368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:14:50.890769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:50.902580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212235-2515-46c1-a6ed-5d81eaa75f49 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:14:50.946420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:50.950845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:14:50.951613 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:14:50.951896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:14:50.952279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:14:50.954061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:14:51.019190 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:14:51.020675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b97c9e-3633-43c1-bb36-2de70f25c95d service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:14:51.030759 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1215/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:14:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:14:58.747788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:01.036955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=28 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:09.644164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2e5a4-2caf-447f-93d9-0abdccf88c0c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:15:09.644665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2e5a4-2caf-447f-93d9-0abdccf88c0c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:15:09.644762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2e5a4-2caf-447f-93d9-0abdccf88c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:15:09.662088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9ae2e5a4-2caf-447f-93d9-0abdccf88c0c None None] MFA Rules not processed for user `bc0272ac06464fb7b430bc8c664208dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:15:09.663311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9ae2e5a4-2caf-447f-93d9-0abdccf88c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:15:09.725795 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1252/2467] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:15:19.709644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=25 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:35.111692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3c6e-6f63-4fdd-9e53-bdd1613041f3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:15:35.112245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3c6e-6f63-4fdd-9e53-bdd1613041f3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:15:35.112245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3c6e-6f63-4fdd-9e53-bdd1613041f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:15:35.130452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f8ad3c6e-6f63-4fdd-9e53-bdd1613041f3 None None] MFA Rules not processed for user `58b706e007fa46c7b8a69508455fcdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:15:35.132505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f8ad3c6e-6f63-4fdd-9e53-bdd1613041f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:15:35.189368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1216/2468] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:15:45.182482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=25 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:46.510603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:15:46.511581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:15:46.511581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:15:46.530401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] MFA Rules not processed for user `dd2ce82718c341e8b1c321a2f128375d`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:15:46.531708 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:15:46.616570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1253/2469] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:15:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:15:51.235641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:15:51.236147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:15:51.236351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:15:51.254281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] MFA Rules not processed for user `0d89a238fc8047cdaaac1047a675cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:15:51.255615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:15:51.312239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1217/2470] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:15:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:15:56.610102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=25 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:00.654541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:00.656080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:00.669315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d5cde-90c4-4f34-b5a7-322c39b7d168 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:00.673016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:00.673672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:00.673958 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:00.674237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:00.676100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:00.762813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:00.764506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:00.777600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1254/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:01.304606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=25 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:02.729615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:02.740489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79839b60-cf40-4a47-a1c7-2b9f0f81a0ff None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:02.745790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:02.746537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:02.746934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:02.747396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:02.749386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:02.765063 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:02.766760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:02.779114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1218/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:06.384735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:06.386493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:06.399973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea880765-c672-4f91-866e-0d4f329a00a9 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:06.405416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:06.406053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:06.406500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:06.406778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:06.408524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:06.418967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:06.420606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:06.430310 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1255/2473] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:12.773765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:13.680132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:13.681511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:13.737150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbbe78-5a2d-417e-b540-67c366c79528 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:13.740696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:13.741410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:13.741692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:13.741965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:13.743766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:13.754961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:13.756392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:13.765630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1219/2474] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:16.425270 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=40 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:23.761502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=26 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:30.965440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:30.977318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c212-f62a-4495-92cd-1d0b02c03082 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:30.982971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:30.983654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:30.983934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:30.984364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:30.986106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:31.001376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:31.003193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:31.015311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1256/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:33.109439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:33.113524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:33.122660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893b1d4-753d-4eb0-8640-26036bc5297b service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:33.126309 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:33.126947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:33.127243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:33.127537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:33.129212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:33.191455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:33.193682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:33.203428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1220/2476] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:37.070363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:37.081326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:37.086727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64464fb4-2411-4dbc-8ca2-527a1a52f2d1 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:37.091644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:37.092552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:37.092850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:37.093121 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] PATH_INFO: `/v3/users/bc0272ac06464fb7b430bc8c664208dd` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:37.094410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0272ac06464fb7b430bc8c664208dd)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:37.096366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:37.287955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0272ac06464fb7b430bc8c664208dd'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.294686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0272ac06464fb7b430bc8c664208dd'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.295417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0272ac06464fb7b430bc8c664208dd'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.296023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0272ac06464fb7b430bc8c664208dd'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.308071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f1a763d-9750-4f80-87f2-f16d329ef724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0272ac06464fb7b430bc8c664208dd'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.386547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1257/2477] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:16:37 2022] DELETE /identity/v3/users/bc0272ac06464fb7b430bc8c664208dd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:37.640927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:37.652170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378a65f-6f76-48e4-9b09-368c08a8c46c service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:37.723289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:37.723289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:37.723289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:37.723289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] PATH_INFO: `/v3/projects/1869e20213214111a0dfcda8b7abeecc` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:37.723776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1869e20213214111a0dfcda8b7abeecc)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:37.725646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:37.840581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1869e20213214111a0dfcda8b7abeecc', 'request_id': 'req-e55aff24-87e7-44ab-9352-3a0255371622'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.847633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1869e20213214111a0dfcda8b7abeecc', 'request_id': 'req-e55aff24-87e7-44ab-9352-3a0255371622'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.924819 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1869e20213214111a0dfcda8b7abeecc', 'request_id': 'req-e55aff24-87e7-44ab-9352-3a0255371622'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.936085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] The token cache is being invalidate because project 1869e20213214111a0dfcda8b7abeecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:16:37.936377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.937011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e55aff24-87e7-44ab-9352-3a0255371622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:37.938550 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1221/2478] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:16:37 2022] DELETE /identity/v3/projects/1869e20213214111a0dfcda8b7abeecc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:37.945065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:37.945490 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:37.945839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:37.964669 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:37.966030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:38.027138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1258/2479] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:38.034892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.035187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.036095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.054265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:38.055492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:38.063225 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1222/2480] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:38.067378 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.076946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41736a-d88d-4936-b943-e72e0e688186 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.081506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.082166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.082938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.083215 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.083974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:16:38.084282 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.085931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.097400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1259/2481] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:16:38.102297 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.111619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc63a-d059-4463-bc6b-4f5071e9b8cd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.116270 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.117588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.117588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.117588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.118183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.120147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.133900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:38.211317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1223/2482] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:16:38 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:38.215499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.226018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c357e0-3a7e-472a-a513-21f3ae2ffd22 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.269416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:38.282703 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.283338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.283707 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.283988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.284687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.287368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.370559 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1260/2483] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:16:38 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:38.374592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.386187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cf9f-6e02-470f-bd6a-c6586bab4b89 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.390809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.391512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.391799 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.392074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.392796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.394391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.405315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1224/2484] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:38.410043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.419298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d642081-c263-4237-a69a-d75b309ee6f5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.424652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d9d05-a931-4be7-a9a2-ce318c351250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.425318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9d05-a931-4be7-a9a2-ce318c351250 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.425619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9d05-a931-4be7-a9a2-ce318c351250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.425899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9d05-a931-4be7-a9a2-ce318c351250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.426644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9d05-a931-4be7-a9a2-ce318c351250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.428285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9d05-a931-4be7-a9a2-ce318c351250 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.439739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1261/2485] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:38.444221 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.454092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdbbbc-3782-4edf-afef-42355789644e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.459289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.460184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.460465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.460761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] PATH_INFO: `/v3/projects/2f90469e862c41f69a2664647368d6e9/users/48bbbc84d51140fb94350c74e6279191/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.474937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f90469e862c41f69a2664647368d6e9, user_id=48bbbc84d51140fb94350c74e6279191, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.477608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.565042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1225/2486] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:38 2022] PUT /identity/v3/projects/2f90469e862c41f69a2664647368d6e9/users/48bbbc84d51140fb94350c74e6279191/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:16:38.583408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.583704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.583984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.612371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] MFA Rules not processed for user `48bbbc84d51140fb94350c74e6279191`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:38.616430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:38.689557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1262/2487] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:38.694801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.759494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7fd7f-edf9-4247-b49c-15fc352d4389 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.769772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.769772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.769772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.769772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.770177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.770177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:38.852256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1226/2488] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:16:38 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:38.856387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:38.867524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dca38-41d9-4a8e-bc0f-c0eb76d81533 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:38.929698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:38.930457 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:38.930738 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:38.931012 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:38.931879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:38.933887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.011577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1263/2489] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:16:38 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:16:39.016046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:39.026572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cab952-8a6e-4507-a979-e43733e324de admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:39.035708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:39.035708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.035708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.035708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.036111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:39.036111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.045295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1227/2490] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:16:39.049224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:39.060129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb45cf-2c65-48ed-a93b-1a3bf9181d94 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:39.065658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:39.066598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.067593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.067877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] PATH_INFO: `/v3/projects/6e264f2dbcfa4bf3b00dc1af5f0d624a/users/3a7e70b90ec14692a8a3b1aecf423642/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.088558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e264f2dbcfa4bf3b00dc1af5f0d624a, user_id=3a7e70b90ec14692a8a3b1aecf423642, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:39.091339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.194149 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1264/2491] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:39 2022] PUT /identity/v3/projects/6e264f2dbcfa4bf3b00dc1af5f0d624a/users/3a7e70b90ec14692a8a3b1aecf423642/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:16:39.198263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:39.208400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06c158-55c6-4c24-9f9d-a80dbee9ae39 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:39.265804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f0fc9-375e-420c-bf89-85a36e58ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:39.266490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0fc9-375e-420c-bf89-85a36e58ef13 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.267681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0fc9-375e-420c-bf89-85a36e58ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.267965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0fc9-375e-420c-bf89-85a36e58ef13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.268762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f0fc9-375e-420c-bf89-85a36e58ef13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:39.270641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f0fc9-375e-420c-bf89-85a36e58ef13 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.281032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1228/2492] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:39.285227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:39.296162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7460abc-3a18-40f5-a248-28a85fd8f2ec admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:39.300805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:39.302267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.302575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.302854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] PATH_INFO: `/v3/projects/6e264f2dbcfa4bf3b00dc1af5f0d624a/users/3a7e70b90ec14692a8a3b1aecf423642/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.304899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e264f2dbcfa4bf3b00dc1af5f0d624a, user_id=3a7e70b90ec14692a8a3b1aecf423642, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:39.307613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.317658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1265/2493] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:39 2022] PUT /identity/v3/projects/6e264f2dbcfa4bf3b00dc1af5f0d624a/users/3a7e70b90ec14692a8a3b1aecf423642/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:39.327625 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.327919 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.328201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.354776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] MFA Rules not processed for user `3a7e70b90ec14692a8a3b1aecf423642`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:39.355961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:39.374401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:39.421717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1229/2494] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:39.434078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:39.435779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:39.445247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:39.492404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c58c7-022f-4b6e-85f4-0883624e921d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:39.496620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:39.497262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.497557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.497839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.506794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:39.508261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.517912 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1266/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:39.640201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:39.650272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee41097-3076-4702-9d9c-2efe14bb54dc None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:39.653846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e4c1-5e72-4794-9915-dafcd1b46d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:39.654487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e4c1-5e72-4794-9915-dafcd1b46d72 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:39.655500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e4c1-5e72-4794-9915-dafcd1b46d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:39.655500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e4c1-5e72-4794-9915-dafcd1b46d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:39.712038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e4c1-5e72-4794-9915-dafcd1b46d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:39.713488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925e4c1-5e72-4794-9915-dafcd1b46d72 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:39.723555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1230/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:40.237305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:40.298380 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b7bf-67c1-43a2-8f00-cebc523c8b9c service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:40.303543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:40.304403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:40.304685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:40.304991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] PATH_INFO: `/v3/users/48bbbc84d51140fb94350c74e6279191` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:40.306183 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bbbc84d51140fb94350c74e6279191)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:40.308132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:40.511001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bbbc84d51140fb94350c74e6279191'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:40.517699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bbbc84d51140fb94350c74e6279191'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:40.518438 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bbbc84d51140fb94350c74e6279191'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:40.519044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bbbc84d51140fb94350c74e6279191'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:40.533336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bbbc84d51140fb94350c74e6279191'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:40.599803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1267/2497] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:16:40 2022] DELETE /identity/v3/users/48bbbc84d51140fb94350c74e6279191 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:40.604499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:40.604791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:40.609174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:40.622928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:40.624220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:40.682992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1231/2498] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:40.692750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:40.694180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:40.726016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:40.751168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93865105-f43e-478a-bfd9-e44f42a59c70 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:40.754854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:40.755545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:40.755833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:40.756113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:40.765320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:40.766726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:40.776488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1268/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:41.223902 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:41.225474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:41.237679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e29e00-ad19-49f3-a847-9c1b0d1155cb None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:41.245857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:41.247444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:41.248456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:41.248456 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] PATH_INFO: `/v3/projects/2f90469e862c41f69a2664647368d6e9` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:41.251227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f90469e862c41f69a2664647368d6e9)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:41.253158 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:41.366040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f90469e862c41f69a2664647368d6e9', 'request_id': 'req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.367050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:41.372647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f90469e862c41f69a2664647368d6e9', 'request_id': 'req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.415862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f90469e862c41f69a2664647368d6e9', 'request_id': 'req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.426261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] The token cache is being invalidate because project 2f90469e862c41f69a2664647368d6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:16:41.426551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.427512 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.428841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1232/2500] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:16:41 2022] DELETE /identity/v3/projects/2f90469e862c41f69a2664647368d6e9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:41.432942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:41.443349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9b7b-cbed-45b5-a169-842036e49192 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:41.497855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:41.498743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:41.499027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:41.499339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] PATH_INFO: `/v3/users/3a7e70b90ec14692a8a3b1aecf423642` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:41.500524 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7e70b90ec14692a8a3b1aecf423642)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:41.502469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:41.636142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7e70b90ec14692a8a3b1aecf423642'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.642964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7e70b90ec14692a8a3b1aecf423642'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.643670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7e70b90ec14692a8a3b1aecf423642'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.644338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7e70b90ec14692a8a3b1aecf423642'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.656988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-00c8da66-fd06-477a-8062-5159e47accae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7e70b90ec14692a8a3b1aecf423642'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:41.730285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1269/2501] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:16:41 2022] DELETE /identity/v3/users/3a7e70b90ec14692a8a3b1aecf423642 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:42.114934 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.116453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:42.129994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da4d1b-ab3b-4bc4-b160-2700a2eda97d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.187375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.188170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.188459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.188740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] PATH_INFO: `/v3/projects/6e264f2dbcfa4bf3b00dc1af5f0d624a` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.189931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e264f2dbcfa4bf3b00dc1af5f0d624a)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.191943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.296436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e264f2dbcfa4bf3b00dc1af5f0d624a', 'request_id': 'req-75b73e58-9466-406b-ba4e-feb05b48a2da'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:42.303130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e264f2dbcfa4bf3b00dc1af5f0d624a', 'request_id': 'req-75b73e58-9466-406b-ba4e-feb05b48a2da'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:42.358707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e264f2dbcfa4bf3b00dc1af5f0d624a', 'request_id': 'req-75b73e58-9466-406b-ba4e-feb05b48a2da'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:42.370164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] The token cache is being invalidate because project 6e264f2dbcfa4bf3b00dc1af5f0d624a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:16:42.370454 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:42.371085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-75b73e58-9466-406b-ba4e-feb05b48a2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:42.372663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1233/2502] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:16:42 2022] DELETE /identity/v3/projects/6e264f2dbcfa4bf3b00dc1af5f0d624a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:42.377651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.377943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.378219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.397485 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:42.398746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:42.443619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:42.457732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1270/2503] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:42.466873 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.467197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.467511 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.486386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:42.487723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:42.496402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1234/2504] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:42.500656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.510488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27e36-c9f9-44c1-94ea-f40080f6ecd9 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.515050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.515745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.516039 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.516319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.517041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:16:42.517350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.518940 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.530751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1271/2505] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:16:42.534875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.544572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c0584-da3e-4e60-8f1e-16cad1567ad8 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.549174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.549821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.550108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.550384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.551113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.553047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.617952 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1235/2506] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:16:42 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:42.624583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.634531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24667594-258e-4a1c-9a19-f48593bddec4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.689272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.689943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.690226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.690504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.691182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.693101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.792902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1272/2507] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:16:42 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:42.796923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.807274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8e2e-5377-4573-9248-330b3845fd85 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.811953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.812652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.812929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.813204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.813924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.815553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.825971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1236/2508] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:42.829742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.844677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f68d-a340-4758-883b-046ffab7336d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.854817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b3445-eda4-4d21-a443-21afe64b442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.855432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3445-eda4-4d21-a443-21afe64b442b admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.855724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3445-eda4-4d21-a443-21afe64b442b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.856000 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3445-eda4-4d21-a443-21afe64b442b admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.856740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b3445-eda4-4d21-a443-21afe64b442b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.858365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b3445-eda4-4d21-a443-21afe64b442b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.868611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1273/2509] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:42.872917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:42.883381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c3c2-6ebd-4e4b-aaa4-89ae2e1392ba admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:42.888243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:42.889127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.889410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.889687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] PATH_INFO: `/v3/projects/978e0d4134ab453ab63f02932c88c8b7/users/477dc19d918845ee8ba3692d093513d6/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:42.904521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978e0d4134ab453ab63f02932c88c8b7, user_id=477dc19d918845ee8ba3692d093513d6, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:42.907174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:42.976489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1237/2510] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:42 2022] PUT /identity/v3/projects/978e0d4134ab453ab63f02932c88c8b7/users/477dc19d918845ee8ba3692d093513d6/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:42.986608 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:42.986907 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:42.987190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:43.013790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] MFA Rules not processed for user `477dc19d918845ee8ba3692d093513d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:43.020186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:43.078320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1274/2511] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:43.089509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:43.091194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:43.097737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:43.148167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830cdf-c6e6-4516-a18d-f6aed83cca17 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:43.151816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:43.152466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:43.152752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:43.153031 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:43.161278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:43.162715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:43.171522 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1238/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:51.264699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:51.266740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:51.350602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:51.359876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77de1c-63d8-464b-a658-8f9a77ebc369 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:51.359876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:51.360563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:51.360846 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:51.361122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:51.363806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:51.373611 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:51.375151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:51.383451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1275/2513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:52.399896 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:52.401341 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:52.492489 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edc0cd-86f4-479e-b557-fe67cea592ef service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:52.498554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:52.499213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:52.499592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:52.499867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:52.501787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:52.515758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:52.517415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a8e54-dba2-422e-a78b-96888eed4889 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:52.531414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1239/2514] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:53.164655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:53.232830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98a68-b656-45dd-ae08-d0cd67a28f48 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:53.237630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:53.238606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:53.238892 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:53.239168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] PATH_INFO: `/v3/users/477dc19d918845ee8ba3692d093513d6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:53.240388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477dc19d918845ee8ba3692d093513d6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:53.242390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:53.436228 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477dc19d918845ee8ba3692d093513d6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:53.444483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477dc19d918845ee8ba3692d093513d6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:53.445578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477dc19d918845ee8ba3692d093513d6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:53.446373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477dc19d918845ee8ba3692d093513d6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:53.460234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477dc19d918845ee8ba3692d093513d6'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:53.575484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1276/2515] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:16:53 2022] DELETE /identity/v3/users/477dc19d918845ee8ba3692d093513d6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:53.580347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:53.580807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:53.580927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:53.598571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:53.599821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:53.657348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1240/2516] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:53.666997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:53.668449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:53.727901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a9770-4bef-4555-8bd7-a4806bf8f2b5 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:53.731735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd3123-9868-49e1-bb51-34f45bff2b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:53.732603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3123-9868-49e1-bb51-34f45bff2b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:53.732890 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3123-9868-49e1-bb51-34f45bff2b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:53.733909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd3123-9868-49e1-bb51-34f45bff2b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:53.742840 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd3123-9868-49e1-bb51-34f45bff2b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:53.744292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd3123-9868-49e1-bb51-34f45bff2b11 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:53.754232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1277/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:54.394183 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:54.395760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:54.409448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcea09-618b-4d51-b36e-c210039b4c6a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:54.414744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:54.415675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:54.415962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:54.416242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] PATH_INFO: `/v3/projects/978e0d4134ab453ab63f02932c88c8b7` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:54.417430 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978e0d4134ab453ab63f02932c88c8b7)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:54.419466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:54.515149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:54.530476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978e0d4134ab453ab63f02932c88c8b7', 'request_id': 'req-96b1d385-cae3-42b0-95a1-e66dde7aac62'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:54.537223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978e0d4134ab453ab63f02932c88c8b7', 'request_id': 'req-96b1d385-cae3-42b0-95a1-e66dde7aac62'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:54.604044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978e0d4134ab453ab63f02932c88c8b7', 'request_id': 'req-96b1d385-cae3-42b0-95a1-e66dde7aac62'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:54.614568 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] The token cache is being invalidate because project 978e0d4134ab453ab63f02932c88c8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:16:54.615155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:54.616278 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-96b1d385-cae3-42b0-95a1-e66dde7aac62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:16:54.617867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1241/2518] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:16:54 2022] DELETE /identity/v3/projects/978e0d4134ab453ab63f02932c88c8b7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:54.622752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:54.623222 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:54.623339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:54.642219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:54.643400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:54.649208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:54.703066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1278/2519] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:16:54.711391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:54.711685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:54.711966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:54.730604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:54.731835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:54.739714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1242/2520] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:54.743789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:54.753336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6288-7109-4df1-93b5-a28548c9c38c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:54.758436 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:54.759082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:54.759400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:54.759672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:54.760639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:16:54.760940 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:54.762586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:54.774384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1279/2521] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:16:54.778655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:54.788606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6e82-dd29-4913-ab69-fbee439864e6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:54.793285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:54.793931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:54.794215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:54.794524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:54.795223 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:54.797146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:54.880310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1243/2522] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:16:54 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:16:54.884519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:54.895553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df11f7-e3b5-4302-a8bc-be62f12d6d5a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:54.955384 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:54.956057 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:54.956339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:54.956615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:54.957949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:54.959899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.022480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1280/2523] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:16:54 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:55.026497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.036785 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f29af-49b6-4d9b-850e-1d2cc65b32b7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.041375 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.042026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.042303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.042578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.043318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.044953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.055594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1244/2524] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:16:55.059315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.069704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886157e9-4742-4e2e-bbc3-5aaa5dee687c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.074259 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1eb4d-aab0-4eab-85db-dc1dff85b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.074914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1eb4d-aab0-4eab-85db-dc1dff85b752 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.075199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1eb4d-aab0-4eab-85db-dc1dff85b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.075500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1eb4d-aab0-4eab-85db-dc1dff85b752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.076218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1eb4d-aab0-4eab-85db-dc1dff85b752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.077830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1eb4d-aab0-4eab-85db-dc1dff85b752 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.088205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1281/2525] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:55.092184 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.102064 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c04c9-bc08-4ffc-b936-840286a3e8e9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.106667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.107569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.107853 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.108138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] PATH_INFO: `/v3/projects/971f30aa7d1f4a2b8ef6a44d42d99c71/users/cae06c8ee2ac4c07b43c0326a80d34b7/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.123153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971f30aa7d1f4a2b8ef6a44d42d99c71, user_id=cae06c8ee2ac4c07b43c0326a80d34b7, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.125839 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.221942 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1245/2526] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:55 2022] PUT /identity/v3/projects/971f30aa7d1f4a2b8ef6a44d42d99c71/users/cae06c8ee2ac4c07b43c0326a80d34b7/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:55.233033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.233328 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.233606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.261726 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] MFA Rules not processed for user `cae06c8ee2ac4c07b43c0326a80d34b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:55.262969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:55.327225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1282/2527] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:55.331668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.392733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b203b-9968-4bbe-99b3-4da729193728 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.397415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.398073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.398358 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.398635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.399351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.401286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.473973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1246/2528] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:16:55 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:55.477853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.489116 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a23816-159d-4264-9b02-50722516b3e1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.492690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:55.547425 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.548102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.548385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.548662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.549365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.551837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.609418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1283/2529] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:16:55 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:55.613973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.624464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbfc79-bb05-44bc-94b4-2c118960ba97 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.629713 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.630414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.630766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.631051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.631818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.633461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.644564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1247/2530] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:55.650348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.660967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec65a-1391-40b8-ab92-f878ecba9a64 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.665617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a631-a342-475f-8014-cff41c18e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.666274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a631-a342-475f-8014-cff41c18e784 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.666563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a631-a342-475f-8014-cff41c18e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.666842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a631-a342-475f-8014-cff41c18e784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.667619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7a631-a342-475f-8014-cff41c18e784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.669217 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7a631-a342-475f-8014-cff41c18e784 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.679653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1284/2531] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:55.683474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.693171 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794650-486c-4cab-9e21-2a96044ce99b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.698118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.698997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.699321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.699608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] PATH_INFO: `/v3/projects/b25ca419c1f94ca0a973f38699a60af8/users/2735455a406047908a85d23088146621/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.714414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25ca419c1f94ca0a973f38699a60af8, user_id=2735455a406047908a85d23088146621, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.717119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:55.787081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1248/2532] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:55 2022] PUT /identity/v3/projects/b25ca419c1f94ca0a973f38699a60af8/users/2735455a406047908a85d23088146621/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:55.797129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.797431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.797712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.824093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] MFA Rules not processed for user `2735455a406047908a85d23088146621`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:55.825306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:55.887845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1285/2533] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:55.892207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:55.896710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:55.954012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453177-1174-410e-b165-d0ecc64b84da admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:55.961012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:55.961673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:55.961956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:55.962231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:55.962930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:55.964960 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.040587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1249/2534] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:16:55 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:56.044473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:56.055143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f130-5dd4-4dad-9a37-c8e0ecb0b268 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:56.109508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:56.110173 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.110454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.110725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.111477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:56.113424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.342120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1286/2535] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:16:56 2022] POST /identity/v3/users => generated 295 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:16:56.346006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:56.356755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22e8a-14bd-4578-aa95-35c7a6ed4388 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:56.361291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:56.361950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.362236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.362516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.363262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:56.364880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.375202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1250/2536] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:56.379536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:56.386020 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:56.389700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7701bb-575e-40ab-a6b4-147361294fc0 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:56.395029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:56.395968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.398909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.398909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] PATH_INFO: `/v3/projects/31b69208337249bd88889c4ffb73ccf6/users/5b072cfceffd4fa792cb8efd4d412fda/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.411771 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b69208337249bd88889c4ffb73ccf6, user_id=5b072cfceffd4fa792cb8efd4d412fda, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:56.414426 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.489858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1287/2537] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:56 2022] PUT /identity/v3/projects/31b69208337249bd88889c4ffb73ccf6/users/5b072cfceffd4fa792cb8efd4d412fda/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:56.493807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:56.504215 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf840df3-fc1e-4040-b932-4c9ef7f56de8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:56.559482 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80ccf7-4ba0-462b-87ba-c17dfbbb1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:56.560148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80ccf7-4ba0-462b-87ba-c17dfbbb1448 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.560433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80ccf7-4ba0-462b-87ba-c17dfbbb1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.560711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80ccf7-4ba0-462b-87ba-c17dfbbb1448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.561861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80ccf7-4ba0-462b-87ba-c17dfbbb1448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:56.563507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80ccf7-4ba0-462b-87ba-c17dfbbb1448 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.573961 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1251/2538] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:16:56.578157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:56.589160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d635f8-8662-4c8d-9aa5-6ec7f870e378 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:56.593804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:56.594630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.594916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.595196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] PATH_INFO: `/v3/projects/31b69208337249bd88889c4ffb73ccf6/users/5b072cfceffd4fa792cb8efd4d412fda/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.597169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b69208337249bd88889c4ffb73ccf6, user_id=5b072cfceffd4fa792cb8efd4d412fda, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:56.599845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.610002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1288/2539] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:16:56 2022] PUT /identity/v3/projects/31b69208337249bd88889c4ffb73ccf6/users/5b072cfceffd4fa792cb8efd4d412fda/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:16:56.621076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.621588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.621695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.653669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] MFA Rules not processed for user `5b072cfceffd4fa792cb8efd4d412fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:16:56.654890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:56.715720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:56.721073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1252/2540] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:16:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:16:56.732204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:56.733922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:56.793179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f0bb5-009e-4919-9e7e-a7193422f3d8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:56.796761 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:56.797513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:56.797794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:56.798069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:56.855964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:56.857413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:56.867048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1289/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:58.387828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:58.389238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:58.462528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58c33-f12c-4c4d-97e6-b24970492f7c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:58.468094 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:58.468747 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:58.469037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:58.469318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:58.471092 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:58.533327 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:58.534929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:58.545200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1253/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:16:58.823900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:16:58.825430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:16:58.837180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2750d7-c467-48e0-881b-f89ce82c4131 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:16:58.840744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c06726-48fd-4fe1-858a-be95e4c888e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:16:58.841393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06726-48fd-4fe1-858a-be95e4c888e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:16:58.841679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06726-48fd-4fe1-858a-be95e4c888e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:16:58.841955 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06726-48fd-4fe1-858a-be95e4c888e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:16:58.902866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c06726-48fd-4fe1-858a-be95e4c888e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:16:58.904623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c06726-48fd-4fe1-858a-be95e4c888e0 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:16:58.914258 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1290/2543] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:16:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:00.395552 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:00.405804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a61a-8296-45a1-be66-2309fd44534b service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:00.409484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:00.410132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:00.410419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:00.410699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:00.419675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:00.421099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:00.430505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1254/2544] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:03.764969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:03.765454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:03.765562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:03.782778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:03.783987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:03.797279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:03.842333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1291/2545] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 09:17:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:04.014788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:04.016295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:04.089326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8b0d-f840-43ae-852b-8564d29e25fc service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:04.094487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fe557-527d-4fd0-badc-8504b20ddf2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:04.095143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fe557-527d-4fd0-badc-8504b20ddf2a service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:04.095469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fe557-527d-4fd0-badc-8504b20ddf2a service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:04.095748 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fe557-527d-4fd0-badc-8504b20ddf2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:04.104601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fe557-527d-4fd0-badc-8504b20ddf2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:04.106191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fe557-527d-4fd0-badc-8504b20ddf2a service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:04.114177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1255/2546] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:17:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:05.108292 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:05.194487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e26ff-caec-42ac-a055-2ba7723d03c3 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:05.199683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:05.200636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:05.200993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:05.201340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] PATH_INFO: `/v3/users/cae06c8ee2ac4c07b43c0326a80d34b7` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:05.202609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae06c8ee2ac4c07b43c0326a80d34b7)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:05.204768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:05.402853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae06c8ee2ac4c07b43c0326a80d34b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:05.410203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae06c8ee2ac4c07b43c0326a80d34b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:05.411557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae06c8ee2ac4c07b43c0326a80d34b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:05.412185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae06c8ee2ac4c07b43c0326a80d34b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:05.426053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae06c8ee2ac4c07b43c0326a80d34b7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:05.506167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1292/2547] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:05 2022] DELETE /identity/v3/users/cae06c8ee2ac4c07b43c0326a80d34b7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:05.511871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:05.512333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:05.512546 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:05.532543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:05.533760 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:05.541970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:05.613777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1256/2548] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:05.624169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:05.625671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:05.715753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:05.731564 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f626a56-3784-413b-8edc-4a23bf50e051 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:05.736011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:05.736750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:05.737025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:05.737307 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:05.747651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:05.749077 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:05.775897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1293/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:06.317524 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:06.318970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:06.330884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552c0c9-0b35-4ac5-8352-76080e8e6f09 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:06.340943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:06.341835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:06.342118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:06.342405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] PATH_INFO: `/v3/projects/971f30aa7d1f4a2b8ef6a44d42d99c71` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:06.343833 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971f30aa7d1f4a2b8ef6a44d42d99c71)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:06.345899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:06.479986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971f30aa7d1f4a2b8ef6a44d42d99c71', 'request_id': 'req-0f9223db-0895-4b91-a364-e9428a6f7db1'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.487060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971f30aa7d1f4a2b8ef6a44d42d99c71', 'request_id': 'req-0f9223db-0895-4b91-a364-e9428a6f7db1'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.604103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971f30aa7d1f4a2b8ef6a44d42d99c71', 'request_id': 'req-0f9223db-0895-4b91-a364-e9428a6f7db1'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.619313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] The token cache is being invalidate because project 971f30aa7d1f4a2b8ef6a44d42d99c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:06.619771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.631334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.631334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1257/2550] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:06 2022] DELETE /identity/v3/projects/971f30aa7d1f4a2b8ef6a44d42d99c71 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:06.631580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:06.639536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df388-3604-415c-a349-a569d68a6662 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:06.698845 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:06.699854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:06.700144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:06.700419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] PATH_INFO: `/v3/users/2735455a406047908a85d23088146621` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:06.701625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2735455a406047908a85d23088146621)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:06.703959 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:06.947926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2735455a406047908a85d23088146621'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.970250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2735455a406047908a85d23088146621'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.971036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2735455a406047908a85d23088146621'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.971698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2735455a406047908a85d23088146621'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:06.987286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2735455a406047908a85d23088146621'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:07.127585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1294/2551] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:06 2022] DELETE /identity/v3/users/2735455a406047908a85d23088146621 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:07.858943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:07.861240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:07.876113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9223db-0895-4b91-a364-e9428a6f7db1 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:07.949476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:07.950543 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:07.951021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:07.951448 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] PATH_INFO: `/v3/projects/b25ca419c1f94ca0a973f38699a60af8` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:07.952571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25ca419c1f94ca0a973f38699a60af8)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:07.954484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:08.074102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:08.084692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25ca419c1f94ca0a973f38699a60af8', 'request_id': 'req-3af8e260-a7da-4eb0-9f86-8c7e008798e4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.091545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25ca419c1f94ca0a973f38699a60af8', 'request_id': 'req-3af8e260-a7da-4eb0-9f86-8c7e008798e4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.164913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25ca419c1f94ca0a973f38699a60af8', 'request_id': 'req-3af8e260-a7da-4eb0-9f86-8c7e008798e4'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.179316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] The token cache is being invalidate because project b25ca419c1f94ca0a973f38699a60af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:08.179618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.180333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.181972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1258/2552] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:07 2022] DELETE /identity/v3/projects/b25ca419c1f94ca0a973f38699a60af8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:08.185932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:08.187379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:08.202069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617cbd-17ca-47f7-af73-80cefa7d7485 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:08.273833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:08.275175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:08.275725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:08.276225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] PATH_INFO: `/v3/users/5b072cfceffd4fa792cb8efd4d412fda` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:08.278131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b072cfceffd4fa792cb8efd4d412fda)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:08.283347 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:08.293554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:08.446510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b072cfceffd4fa792cb8efd4d412fda'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.454011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b072cfceffd4fa792cb8efd4d412fda'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.454826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b072cfceffd4fa792cb8efd4d412fda'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.455451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b072cfceffd4fa792cb8efd4d412fda'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.468275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b072cfceffd4fa792cb8efd4d412fda'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:08.610187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1295/2553] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:08 2022] DELETE /identity/v3/users/5b072cfceffd4fa792cb8efd4d412fda => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:08.942682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:08.944867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:08.960042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e260-a7da-4eb0-9f86-8c7e008798e4 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:09.026999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:09.027922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.028211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.028493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] PATH_INFO: `/v3/users/dd2ce82718c341e8b1c321a2f128375d` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.029734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2ce82718c341e8b1c321a2f128375d)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:09.036721 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:09.203504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:09.203504 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:09.218948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906a8e-fedc-4b60-b9bf-ae0e7349610b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:09.223677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:09.224555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.224839 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.225117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] PATH_INFO: `/v3/projects/31b69208337249bd88889c4ffb73ccf6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.226553 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b69208337249bd88889c4ffb73ccf6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:09.228643 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:09.259162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2ce82718c341e8b1c321a2f128375d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.273744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2ce82718c341e8b1c321a2f128375d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.274559 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2ce82718c341e8b1c321a2f128375d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.278340 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2ce82718c341e8b1c321a2f128375d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.297338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-28665706-8803-4015-94c2-94eeaeedffd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2ce82718c341e8b1c321a2f128375d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.363962 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b69208337249bd88889c4ffb73ccf6', 'request_id': 'req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.375333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b69208337249bd88889c4ffb73ccf6', 'request_id': 'req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.377865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1259/2554] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:08 2022] DELETE /identity/v3/users/dd2ce82718c341e8b1c321a2f128375d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:09.449978 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b69208337249bd88889c4ffb73ccf6', 'request_id': 'req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.472317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] The token cache is being invalidate because project 31b69208337249bd88889c4ffb73ccf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:09.472317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.473078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-28aeb95b-3cda-45a2-bcf5-b7b46dfd29dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.478234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1296/2555] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:09 2022] DELETE /identity/v3/projects/31b69208337249bd88889c4ffb73ccf6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:17:09.480382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.480821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.481211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.504388 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:09.505795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:09.555086 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:09.586895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1260/2556] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:09.595206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.595745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.596180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.617092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:09.618680 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:09.627946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1297/2557] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:09.633705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:09.645474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7ec19-e882-4461-ab78-f0a25b936720 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:09.651449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:09.656697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.657179 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.657637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.658631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:09.659154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:17:09.659703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:09.661303 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:09.661800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:09.683927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dbd0c-dadf-4840-a992-b05f94b98664 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:09.692153 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:09.693196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.693489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.694930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] PATH_INFO: `/v3/projects/c5393c21cbc043318c9338c11264d29d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.695623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1261/2558] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:17:09.696606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:09.697203 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5393c21cbc043318c9338c11264d29d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:09.699634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:09.708965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0babfd-61cf-4a3d-bd8b-ac83752e0919 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:09.715970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:09.716477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:09.716766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:09.717047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:09.717752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:09.720006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:09.831017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1262/2559] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:17:09 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:09.836397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:09.861461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5393c21cbc043318c9338c11264d29d', 'request_id': 'req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.869290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5393c21cbc043318c9338c11264d29d', 'request_id': 'req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.874245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:09.934973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5393c21cbc043318c9338c11264d29d', 'request_id': 'req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.947647 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] The token cache is being invalidate because project c5393c21cbc043318c9338c11264d29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:09.947943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.948606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:09.950177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1298/2560] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:09 2022] DELETE /identity/v3/projects/c5393c21cbc043318c9338c11264d29d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:09.952205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89c80e-d659-4e7c-ab09-09f5da3cac89 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:10.037234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:10.038980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:10.039402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:10.039780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:10.040587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:10.042911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:10.188108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1263/2561] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:17:09 2022] POST /identity/v3/users => generated 300 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:17:10.191819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:10.193227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:10.219568 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f1594-2d8c-4b38-8834-e46b1c07cd7b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:10.227813 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:10.228683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:10.229037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:10.229376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:10.230250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:10.232343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:10.245322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1299/2562] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:17:10.249305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:10.260650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74877a9-19d0-4e1d-a7a5-ceace33bc295 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:10.265222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fac49-fea3-4664-9cfa-f1bc855f73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:10.265899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fac49-fea3-4664-9cfa-f1bc855f73c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:10.266173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fac49-fea3-4664-9cfa-f1bc855f73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:10.266453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fac49-fea3-4664-9cfa-f1bc855f73c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:10.267178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fac49-fea3-4664-9cfa-f1bc855f73c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:10.268823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fac49-fea3-4664-9cfa-f1bc855f73c8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:10.279077 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1264/2563] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:17:10.283460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:10.293582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458341de-f229-4b1f-b0c4-cf5d2167613a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:10.298227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:10.299122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:10.299442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:10.299728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] PATH_INFO: `/v3/projects/95dc5b167dd4493ab67a9f260419dcf5/users/0ba74b58d6ac4bc68d51ad46062ce572/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:10.317455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dc5b167dd4493ab67a9f260419dcf5, user_id=0ba74b58d6ac4bc68d51ad46062ce572, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:10.320831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:10.410244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1300/2564] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:17:10 2022] PUT /identity/v3/projects/95dc5b167dd4493ab67a9f260419dcf5/users/0ba74b58d6ac4bc68d51ad46062ce572/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:10.424932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:10.425303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:10.425715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:10.452979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] MFA Rules not processed for user `0ba74b58d6ac4bc68d51ad46062ce572`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:10.454137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:10.478777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:10.520418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1265/2565] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:17:10.531855 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:10.533599 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:10.592618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21ddb-d8bd-46a6-a51c-1473bf2a59e1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:10.596276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:10.597029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:10.597318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:10.597593 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:10.606396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:10.607961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:10.618190 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1301/2566] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:14.079261 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:14.083592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:14.148163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f27f0d-0b3e-468d-bb50-407b9dd62947 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:14.152769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:14.153650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:14.153935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:14.154213 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] PATH_INFO: `/v3/users/12293a5616e2410fb173a0b4424e63ff` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:14.155440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12293a5616e2410fb173a0b4424e63ff)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:14.157359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:14.349442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12293a5616e2410fb173a0b4424e63ff'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.356330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12293a5616e2410fb173a0b4424e63ff'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.357006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12293a5616e2410fb173a0b4424e63ff'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.357617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12293a5616e2410fb173a0b4424e63ff'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.369300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12293a5616e2410fb173a0b4424e63ff'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.426163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1266/2567] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:14 2022] DELETE /identity/v3/users/12293a5616e2410fb173a0b4424e63ff => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:14.680050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:14.693066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b251e2-0c94-4d21-ba92-70f7f0c1eb34 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:14.751664 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:14.752532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:14.752818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:14.753096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] PATH_INFO: `/v3/projects/eb2c902507914576a1d06ba54a87df1d` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:14.754334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2c902507914576a1d06ba54a87df1d)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:14.756284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:14.855428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2c902507914576a1d06ba54a87df1d', 'request_id': 'req-e9b86d8c-ef64-4308-b087-443d1e981b2f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.861402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2c902507914576a1d06ba54a87df1d', 'request_id': 'req-e9b86d8c-ef64-4308-b087-443d1e981b2f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.863053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:14.940812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2c902507914576a1d06ba54a87df1d', 'request_id': 'req-e9b86d8c-ef64-4308-b087-443d1e981b2f'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.953454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] The token cache is being invalidate because project eb2c902507914576a1d06ba54a87df1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:14.953752 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.954424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:14.958984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1302/2568] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:14 2022] DELETE /identity/v3/projects/eb2c902507914576a1d06ba54a87df1d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:14.960185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:14.961867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:14.975134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7f49f-ca0f-4335-a640-c98afc8201c0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:15.017217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:15.031401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:15.032299 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:15.032610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:15.032887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] PATH_INFO: `/v3/users/db5bfc040fed42c5ae2d73b747c26936` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:15.034074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5bfc040fed42c5ae2d73b747c26936)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:15.036047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:15.211752 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5bfc040fed42c5ae2d73b747c26936'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.220737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5bfc040fed42c5ae2d73b747c26936'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.221863 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5bfc040fed42c5ae2d73b747c26936'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.222461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5bfc040fed42c5ae2d73b747c26936'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.234998 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5bfc040fed42c5ae2d73b747c26936'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.312442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1267/2569] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:14 2022] DELETE /identity/v3/users/db5bfc040fed42c5ae2d73b747c26936 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:15.616536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:15.618042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:15.631646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b86d8c-ef64-4308-b087-443d1e981b2f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:15.690038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:15.690895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:15.691175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:15.691480 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] PATH_INFO: `/v3/projects/cca25b196d924e45b54eb31aef4604af` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:15.692649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca25b196d924e45b54eb31aef4604af)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:15.694584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:15.774889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca25b196d924e45b54eb31aef4604af', 'request_id': 'req-f25f1775-a34c-462d-a72b-6c770f5c915e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.781118 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca25b196d924e45b54eb31aef4604af', 'request_id': 'req-f25f1775-a34c-462d-a72b-6c770f5c915e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.860620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca25b196d924e45b54eb31aef4604af', 'request_id': 'req-f25f1775-a34c-462d-a72b-6c770f5c915e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.871616 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] The token cache is being invalidate because project cca25b196d924e45b54eb31aef4604af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:15.871902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.872517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f25f1775-a34c-462d-a72b-6c770f5c915e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:15.874102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1303/2570] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:15 2022] DELETE /identity/v3/projects/cca25b196d924e45b54eb31aef4604af => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:19.516185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:19.517679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:19.530465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0da10-fede-49c2-a1b3-90cf7534e9e8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:19.586510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:19.587415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:19.587695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:19.587979 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] PATH_INFO: `/v3/users/0ba74b58d6ac4bc68d51ad46062ce572` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:19.589139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba74b58d6ac4bc68d51ad46062ce572)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:19.591119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:19.791046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba74b58d6ac4bc68d51ad46062ce572'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:19.799168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba74b58d6ac4bc68d51ad46062ce572'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:19.800024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba74b58d6ac4bc68d51ad46062ce572'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:19.801002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba74b58d6ac4bc68d51ad46062ce572'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:19.812893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:19.818466 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-46de93c8-b5e1-4aa2-b47b-a68744ca057e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba74b58d6ac4bc68d51ad46062ce572'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:19.901135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1268/2571] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:19 2022] DELETE /identity/v3/users/0ba74b58d6ac4bc68d51ad46062ce572 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:19.906671 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:19.908395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:19.908395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:19.924230 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:19.925073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:19.925413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:19.926706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:19.927951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:19.946035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:19.947474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:19.995536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1304/2572] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:17:20.005132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:20.006500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:20.009016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1269/2573] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:17:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:20.020864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:20.022544 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:20.023936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:20.066582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fa972-f5d1-4df1-878a-41dfa818514c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:20.070424 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:20.071689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:20.071891 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:20.072168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:20.081657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:20.083179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:20.094704 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1305/2574] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:17:20.094932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b83961-a5de-4375-9caf-5b79917db209 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:20.100668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671da9d-c2da-41d5-83d3-3b776741ab89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:20.101325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671da9d-c2da-41d5-83d3-3b776741ab89 service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:20.101609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671da9d-c2da-41d5-83d3-3b776741ab89 service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:20.101892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671da9d-c2da-41d5-83d3-3b776741ab89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:20.111129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671da9d-c2da-41d5-83d3-3b776741ab89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:20.112778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671da9d-c2da-41d5-83d3-3b776741ab89 service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:20.133457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1270/2575] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:17:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 09:17:20.503601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:20.505047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:20.520933 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720286a2-d336-4d70-8208-3486bef6cfb4 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:20.527460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:20.528360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:20.528646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:20.528926 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] PATH_INFO: `/v3/projects/95dc5b167dd4493ab67a9f260419dcf5` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:20.530218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95dc5b167dd4493ab67a9f260419dcf5)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:20.532360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:20.676316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95dc5b167dd4493ab67a9f260419dcf5', 'request_id': 'req-ffade25a-34a4-4c78-83f7-8e86d0641d60'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:20.686407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95dc5b167dd4493ab67a9f260419dcf5', 'request_id': 'req-ffade25a-34a4-4c78-83f7-8e86d0641d60'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:20.786685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95dc5b167dd4493ab67a9f260419dcf5', 'request_id': 'req-ffade25a-34a4-4c78-83f7-8e86d0641d60'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:20.806953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] The token cache is being invalidate because project 95dc5b167dd4493ab67a9f260419dcf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:20.807500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:20.808402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ffade25a-34a4-4c78-83f7-8e86d0641d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:20.810382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1306/2576] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:20 2022] DELETE /identity/v3/projects/95dc5b167dd4493ab67a9f260419dcf5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:20.819523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:20.820421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:20.820779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:20.845655 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:20.847660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:20.939409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1271/2577] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:20.941275 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:20.941751 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:20.941849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:20.987770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:20.989617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:21.005790 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1307/2578] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:21.007056 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.018418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49f68-5aa9-411c-acc6-c2c2ef490e13 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.024440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.025209 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.025426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.025671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.026418 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:17:21.026744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.028541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.043316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1272/2579] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:17:21.047201 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.058193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bea1e-12ed-4ad4-9c7d-312bbd332575 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.064182 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.065208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.065721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.066218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.067785 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.070874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.179206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.182182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:21.191771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:21.200984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1308/2580] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:17:21 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:21.202098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.304496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e2aa-df36-45fb-9bb2-caed76f4fa30 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.311402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.312181 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.312546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.313536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.313927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.316544 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.324775 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ce11-a89a-45fd-aaeb-b80e94fa78b5 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.348906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:21.433925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.434581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.434870 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.435146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.437498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:21.442825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1309/2581] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:17:21 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:21.447371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.454827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.456644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.467434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3f23-e7bb-44e5-bd3f-07baa66750fa admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.469103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1273/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:17:21.481570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.482358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.487967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.488501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.491499 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.493235 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.522775 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1310/2583] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:17:21.524218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.538629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f01ea-3b9b-4cd9-b890-443505492bfb service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.557093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948876-467d-4c54-9703-de020973343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.557693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948876-467d-4c54-9703-de020973343a admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.557985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948876-467d-4c54-9703-de020973343a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.558273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948876-467d-4c54-9703-de020973343a admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.559012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948876-467d-4c54-9703-de020973343a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.560735 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948876-467d-4c54-9703-de020973343a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.574302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1274/2584] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:17:21.578543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.589963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8d53c-ff39-4bcb-949b-06c7c06002da admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.595060 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.596178 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.596663 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.597129 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] PATH_INFO: `/v3/projects/5ec06218a20940509976a1e656176d9b/users/5d38aab25eca47c888d3add258ce3cff/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.616361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec06218a20940509976a1e656176d9b, user_id=5d38aab25eca47c888d3add258ce3cff, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.619040 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.702422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1311/2585] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:17:21 2022] PUT /identity/v3/projects/5ec06218a20940509976a1e656176d9b/users/5d38aab25eca47c888d3add258ce3cff/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:21.704292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c15cd-9956-4f8c-83d1-d91904439e2b None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.704680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c15cd-9956-4f8c-83d1-d91904439e2b None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.705042 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c15cd-9956-4f8c-83d1-d91904439e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.726114 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-8b9c15cd-9956-4f8c-83d1-d91904439e2b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:21.727390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-8b9c15cd-9956-4f8c-83d1-d91904439e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:21.795802 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1275/2586] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:17:21.806393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:21.808340 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:21.883828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f6340-dfec-489f-b92e-dfad9656c293 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:21.888799 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:21.889461 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:21.889742 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:21.890034 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:21.900858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:21.902427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:21.926662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1312/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:29.702848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:29.703406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:29.703581 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:29.738875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] MFA Rules not processed for user `5d38aab25eca47c888d3add258ce3cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:29.740425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:29.752178 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:29.856126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1276/2588] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:29.863192 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:29.873411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d511be-7d90-415e-a84c-75a64d5a08cc service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:29.880398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:29.881128 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:29.881417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:29.881702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:29.882420 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:29.884379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:29.979713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1313/2589] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:17:29 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:17:29.984133 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:29.997214 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713d469-2ef5-4635-b6d6-b1fb297ae5dd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:30.079875 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:30.082372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:30.082372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:30.082372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:30.082372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:30.083773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:30.169072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1277/2590] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:17:29 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:30.172750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:30.185655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9d33-fae1-4d15-ac3b-e203c7c35796 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:30.191729 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:30.193868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:30.193868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:30.193868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:30.194674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:30.197168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:30.240986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1314/2591] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:17:30.242110 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:30.253745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a09c2-afea-4107-b148-535f5592a36d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:30.260480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:30.261725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:30.262196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:30.262587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] PATH_INFO: `/v3/projects/d62e8b3c889a4a7d9ad49802644593d1/users/bc403a28446e4869b4ae1580ae9386a1/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:30.285369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62e8b3c889a4a7d9ad49802644593d1, user_id=bc403a28446e4869b4ae1580ae9386a1, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:30.290805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:30.372043 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1278/2592] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:17:30 2022] PUT /identity/v3/projects/d62e8b3c889a4a7d9ad49802644593d1/users/bc403a28446e4869b4ae1580ae9386a1/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:30.376311 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:30.392017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5a9b-834a-45ae-bc72-50a1309cbf42 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:30.469560 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96be4-b82a-4945-89de-13167464f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:30.470536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96be4-b82a-4945-89de-13167464f5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:30.470821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96be4-b82a-4945-89de-13167464f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:30.471101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96be4-b82a-4945-89de-13167464f5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:30.471875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96be4-b82a-4945-89de-13167464f5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:30.473841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96be4-b82a-4945-89de-13167464f5c2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:30.490989 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1315/2593] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:17:30.492292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:30.503061 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b3cd9-ebc4-427e-a4b4-5f925a066707 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:30.512708 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:30.513803 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:30.514316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:30.514664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] PATH_INFO: `/v3/projects/d62e8b3c889a4a7d9ad49802644593d1/users/bc403a28446e4869b4ae1580ae9386a1/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:30.517615 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62e8b3c889a4a7d9ad49802644593d1, user_id=bc403a28446e4869b4ae1580ae9386a1, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:30.522208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:30.537589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1279/2594] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:17:30 2022] PUT /identity/v3/projects/d62e8b3c889a4a7d9ad49802644593d1/users/bc403a28446e4869b4ae1580ae9386a1/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:37.327830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a6711-0199-4abb-83d9-c0330b249505 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:37.328207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a6711-0199-4abb-83d9-c0330b249505 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:37.328407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a6711-0199-4abb-83d9-c0330b249505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:37.359164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-598a6711-0199-4abb-83d9-c0330b249505 None None] MFA Rules not processed for user `bc403a28446e4869b4ae1580ae9386a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:37.360710 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-598a6711-0199-4abb-83d9-c0330b249505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:37.370513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:37.440497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1316/2595] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:37.455323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:37.530818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:37.548376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb2cb-09c6-444d-9ce4-cf9786a6e224 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:37.555210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:37.556089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:37.556639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:37.557120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:37.621162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:37.622773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:37.633344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1280/2596] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:40.528154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff27f6-0977-4416-b5bf-045dd93b06cb None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:40.529104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff27f6-0977-4416-b5bf-045dd93b06cb None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:40.530160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff27f6-0977-4416-b5bf-045dd93b06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:40.551842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-0dff27f6-0977-4416-b5bf-045dd93b06cb None None] MFA Rules not processed for user `5d38aab25eca47c888d3add258ce3cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:40.554641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0dff27f6-0977-4416-b5bf-045dd93b06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:40.570458 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1317/2597] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:42.111464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:42.168417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976e93e-a6e9-4789-9ba4-40d72f037dbe service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:42.172102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:42.172770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:42.173427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:42.173427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:42.176100 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:42.186313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:42.187903 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0ce8a-187c-4ff2-8f47-1c666482e7a2 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:42.198169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1281/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:42.572759 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717422-409e-4cb8-ab0a-976ae071a86e None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:42.573812 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717422-409e-4cb8-ab0a-976ae071a86e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:42.574674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717422-409e-4cb8-ab0a-976ae071a86e None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:42.581713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1318/2599] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:17:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:17:42.588497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26693569-7ebc-494c-9da8-14afd0a814f8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:42.594073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26693569-7ebc-494c-9da8-14afd0a814f8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:42.594073 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26693569-7ebc-494c-9da8-14afd0a814f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:42.621010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-26693569-7ebc-494c-9da8-14afd0a814f8 None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:42.622516 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-26693569-7ebc-494c-9da8-14afd0a814f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:42.645091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1282/2600] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:42.655280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa717422-409e-4cb8-ab0a-976ae071a86e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:42.657298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-aa717422-409e-4cb8-ab0a-976ae071a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:42.743018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa717422-409e-4cb8-ab0a-976ae071a86e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:42.746584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994e1c3-ef96-42c1-aec2-56c425bdbed4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:42.747250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994e1c3-ef96-42c1-aec2-56c425bdbed4 service glance] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:42.747606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994e1c3-ef96-42c1-aec2-56c425bdbed4 service glance] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:42.747881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994e1c3-ef96-42c1-aec2-56c425bdbed4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:42.758685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994e1c3-ef96-42c1-aec2-56c425bdbed4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:42.760418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994e1c3-ef96-42c1-aec2-56c425bdbed4 service glance] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:42.770966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1319/2601] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:42.952374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a95ce9-aa10-41e7-9ea6-08510e1d31e1 None None] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:42.952667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a95ce9-aa10-41e7-9ea6-08510e1d31e1 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:42.952953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a95ce9-aa10-41e7-9ea6-08510e1d31e1 None None] PATH_INFO: `/` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:42.954502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1283/2602] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:17:42.959876 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993588f-6727-4bb3-a718-a5b64b325d74 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:42.960262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993588f-6727-4bb3-a718-a5b64b325d74 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:42.960604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993588f-6727-4bb3-a718-a5b64b325d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:42.987673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4993588f-6727-4bb3-a718-a5b64b325d74 None None] MFA Rules not processed for user `29b8fa2fe2d046dcadd150265b166d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:42.989095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4993588f-6727-4bb3-a718-a5b64b325d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:42.996537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1320/2603] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:17:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:43.009030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a95ce9-aa10-41e7-9ea6-08510e1d31e1 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:43.020809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a95ce9-aa10-41e7-9ea6-08510e1d31e1 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:43.024322 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fed03-df5b-4aba-9809-1c63558d1394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:43.024980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fed03-df5b-4aba-9809-1c63558d1394 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:43.025264 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fed03-df5b-4aba-9809-1c63558d1394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:43.025538 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fed03-df5b-4aba-9809-1c63558d1394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:43.033498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fed03-df5b-4aba-9809-1c63558d1394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:43.034948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fed03-df5b-4aba-9809-1c63558d1394 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:43.047965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1284/2604] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:43.143818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1be6-3cc9-4bde-9dc0-9c75ab3ff231 None None] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:43.144164 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1be6-3cc9-4bde-9dc0-9c75ab3ff231 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:43.144496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1be6-3cc9-4bde-9dc0-9c75ab3ff231 None None] PATH_INFO: `/` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:43.146412 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1321/2605] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 2 09:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:17:43.152211 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:43.152707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:43.152801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:43.173018 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] MFA Rules not processed for user `7d7ba842465543478b83e1bf3c018223`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:43.174287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:43.184113 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1285/2606] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 2 09:17:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:43.197455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee1be6-3cc9-4bde-9dc0-9c75ab3ff231 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:43.209067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee1be6-3cc9-4bde-9dc0-9c75ab3ff231 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:43.212600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbcbc4-8eb9-4727-83cf-88194887bdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:43.213272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbcbc4-8eb9-4727-83cf-88194887bdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:43.213547 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbcbc4-8eb9-4727-83cf-88194887bdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:43.213818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbcbc4-8eb9-4727-83cf-88194887bdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:43.223899 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbcbc4-8eb9-4727-83cf-88194887bdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:43.225957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbcbc4-8eb9-4727-83cf-88194887bdd1 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:43.237334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1322/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:43.300770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:43.302356 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:43.384201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c8146-53d1-48ad-be99-825b55192aae None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:43.390199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:43.390723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:43.390980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:43.391263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:43.394880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:43.409950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:43.412495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:43.423656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1286/2608] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:45.842596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:45.843045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:45.843177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:45.861388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:45.862579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:45.924558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1323/2609] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 2 09:17:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:45.937272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:45.938705 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:45.944323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:46.015170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d1a4-8b8c-4f11-a5b2-77bd05b8485b service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:46.020166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:46.020997 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:46.021313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:46.021682 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:46.032323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:46.038025 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:46.043925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1287/2610] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:17:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:47.298828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:47.318580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd870a9e-36b8-4a70-b33c-5fe373707320 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:47.322509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:47.323267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:47.323644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:47.324001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:47.325886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:47.332788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=100 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:47.404701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:47.406747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:47.429618 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1324/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:51.884718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:51.898396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39dad8-2839-4305-a05a-d65cc811e22f service swift] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:51.905935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:51.906889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:51.907370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:51.907821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:51.909937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:51.936685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:51.938255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:51.961504 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1288/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:52.093660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:52.093660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:52.115716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3923b2-7517-45e7-93b4-ec6579144672 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:52.122674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:52.123678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:52.124084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:52.124619 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] PATH_INFO: `/v3/users/0d89a238fc8047cdaaac1047a675cfbb` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:52.125986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d89a238fc8047cdaaac1047a675cfbb)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:52.128315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:52.271957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d89a238fc8047cdaaac1047a675cfbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:52.279754 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d89a238fc8047cdaaac1047a675cfbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:52.283388 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d89a238fc8047cdaaac1047a675cfbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:52.284018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d89a238fc8047cdaaac1047a675cfbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:52.298602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-b49bab4f-c48f-446d-8c4b-dc694066b815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d89a238fc8047cdaaac1047a675cfbb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:52.589563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1325/2613] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:52 2022] DELETE /identity/v3/users/0d89a238fc8047cdaaac1047a675cfbb => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:52.982197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:52.999274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2e5e-1f11-4a3b-9128-affbd68b22e1 service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:53.072834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:53.073738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:53.074026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:53.075272 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] PATH_INFO: `/v3/projects/597dc461d8a042e19ad99324a626aac1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:53.075608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=597dc461d8a042e19ad99324a626aac1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:53.077647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:53.226777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597dc461d8a042e19ad99324a626aac1', 'request_id': 'req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:53.233231 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597dc461d8a042e19ad99324a626aac1', 'request_id': 'req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:53.293813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597dc461d8a042e19ad99324a626aac1', 'request_id': 'req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:53.310677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] The token cache is being invalidate because project 597dc461d8a042e19ad99324a626aac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:53.310984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:53.311693 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d2b4ac62-b804-43d5-8fe3-af3b1f4809cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:53.313389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1289/2614] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:52 2022] DELETE /identity/v3/projects/597dc461d8a042e19ad99324a626aac1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:53.318615 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:53.322107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:53.322107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:53.339541 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:53.340800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:53.403818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1326/2615] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:53.412904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:53.413262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:53.413462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:53.433720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:53.434953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:53.445247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1290/2616] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:17:53.448968 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:53.460806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbffcc-2ccf-4e27-924f-249074ccc4c5 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:53.466133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:53.466895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:53.467273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:53.467683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:53.468489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:17:53.468862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:53.470569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:53.487267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1327/2617] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:17:53.488720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:53.494081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:53.499608 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf729b-659a-4b03-bd48-4d0af01f8ce8 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:53.506645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:53.506645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:53.506645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:53.506645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:53.507191 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:53.508205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:53.631555 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1291/2618] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:53.635806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:53.641256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:53.649064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4eff-67f1-4a23-b789-dd958496e2aa admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:53.726251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:53.727132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:53.727511 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:53.728142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:53.728987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:53.731737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:54.632699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1328/2619] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:17:53 2022] POST /identity/v3/users => generated 287 bytes in 998 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:54.641220 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:54.647485 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e23096-d2ab-4e58-9c5d-5caae05f586e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:54.651981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:54.652707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:54.652994 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:54.653273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:54.653999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:54.655644 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:54.665423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1292/2620] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:17:54.672395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:54.682929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a0278-a169-4b98-a384-6841f82d4125 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:54.687617 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724a8f1-a459-40a1-b995-e26a218b0afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:54.688273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724a8f1-a459-40a1-b995-e26a218b0afc admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:54.688554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724a8f1-a459-40a1-b995-e26a218b0afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:54.688830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724a8f1-a459-40a1-b995-e26a218b0afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:54.689550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724a8f1-a459-40a1-b995-e26a218b0afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:54.691132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724a8f1-a459-40a1-b995-e26a218b0afc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:54.703297 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1329/2621] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:17:54.707370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:54.717232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501291c-2712-415e-993b-5d3618b5373a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:54.721678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:54.722571 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:54.722854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:54.723124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] PATH_INFO: `/v3/projects/0ada9dbfe85843f7bf57d78f5949c061/users/3c2f667f7ece4c58a12924c734a2e6a2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:54.737247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ada9dbfe85843f7bf57d78f5949c061, user_id=3c2f667f7ece4c58a12924c734a2e6a2, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:54.740532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:54.819612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1293/2622] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:17:54 2022] PUT /identity/v3/projects/0ada9dbfe85843f7bf57d78f5949c061/users/3c2f667f7ece4c58a12924c734a2e6a2/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:54.829678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:54.829969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:54.830248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:54.855987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] MFA Rules not processed for user `3c2f667f7ece4c58a12924c734a2e6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:54.857199 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:54.923477 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1330/2623] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:54.934733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:54.936465 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:55.011699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71d40a-4540-4c82-9d06-5dfee7227dc7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:55.017439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3b19c-5111-453f-977b-a6cbccd5b6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:55.018091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3b19c-5111-453f-977b-a6cbccd5b6ee service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:55.018377 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3b19c-5111-453f-977b-a6cbccd5b6ee service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:55.018657 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3b19c-5111-453f-977b-a6cbccd5b6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:55.026653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3b19c-5111-453f-977b-a6cbccd5b6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:55.028263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3b19c-5111-453f-977b-a6cbccd5b6ee service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:55.037770 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1294/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:58.158940 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:58.212291 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cb0d7-4e17-479b-a72a-db0d9cdf6566 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:58.216804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:58.217677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:58.217965 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:58.218245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] PATH_INFO: `/v3/users/3c2f667f7ece4c58a12924c734a2e6a2` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:58.219464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2f667f7ece4c58a12924c734a2e6a2)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:58.221381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:58.233979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:58.398518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2f667f7ece4c58a12924c734a2e6a2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:58.405236 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2f667f7ece4c58a12924c734a2e6a2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:58.405929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2f667f7ece4c58a12924c734a2e6a2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:58.406600 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2f667f7ece4c58a12924c734a2e6a2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:58.419250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2f667f7ece4c58a12924c734a2e6a2'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:58.482437 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1331/2625] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:17:58 2022] DELETE /identity/v3/users/3c2f667f7ece4c58a12924c734a2e6a2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:58.487117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:58.487617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:58.487723 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:58.506834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:58.508090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:58.584468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1295/2626] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:58.596167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:58.597607 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:58.657484 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877203ef-e0c4-4110-bb9f-dc574a4d70cc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:58.661195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:58.664528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:58.664528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:58.664528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:58.671847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:58.673329 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:58.683145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1332/2627] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:17:58.976262 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:58.986095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7d731-7e08-44b5-b529-60eeeb62a3e9 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:58.990823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:58.990823 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:58.991128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:58.991359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:58.993255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:59.003928 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:59.006027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe2b8-f169-4444-b644-26471a591771 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:59.014624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1296/2628] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:17:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:17:59.177054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:59.179092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:59.199562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04b1a6-df53-4c27-9476-009f1129c021 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:59.204928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:59.206369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.206860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.207226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] PATH_INFO: `/v3/projects/0ada9dbfe85843f7bf57d78f5949c061` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.209115 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ada9dbfe85843f7bf57d78f5949c061)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:59.211588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:59.318641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ada9dbfe85843f7bf57d78f5949c061', 'request_id': 'req-f181d122-227f-4915-a509-5a908af9a690'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:59.326566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ada9dbfe85843f7bf57d78f5949c061', 'request_id': 'req-f181d122-227f-4915-a509-5a908af9a690'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:59.477469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ada9dbfe85843f7bf57d78f5949c061', 'request_id': 'req-f181d122-227f-4915-a509-5a908af9a690'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:59.489854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] The token cache is being invalidate because project 0ada9dbfe85843f7bf57d78f5949c061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:17:59.490408 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:59.491160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f181d122-227f-4915-a509-5a908af9a690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:17:59.493233 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1333/2629] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:17:59 2022] DELETE /identity/v3/projects/0ada9dbfe85843f7bf57d78f5949c061 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:17:59.499442 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.500271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.500271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.519677 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:59.521125 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:59.533583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:59.581248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1297/2630] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:17:59.589324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.589620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.589902 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.609670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:17:59.610887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:17:59.620393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1334/2631] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:17:59.624635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:59.634289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1683b-b990-4268-b88a-fda4f435b348 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:59.639161 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:59.639851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.640143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.640419 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.641186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:17:59.641490 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:59.643111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:59.656088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1298/2632] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:17:59.660393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:59.670640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c525-e7ba-4051-9f31-8579d780e16d None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:59.675365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:59.676022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.676341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.677169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.677304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:59.679295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:59.683724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:59.761975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1335/2633] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:17:59 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:17:59.763593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:59.775102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d063-17be-4c92-b545-5553c2103ca7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:59.841408 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:59.842828 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.843291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.843640 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.844548 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:59.846642 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:59.948476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1299/2634] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:17:59 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:17:59.952670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:17:59.965500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14706393-8fa5-4231-85e7-551ac594b157 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:17:59.971908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:17:59.972709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:17:59.973889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:17:59.974033 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:17:59.974836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:17:59.976765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:17:59.988706 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1336/2635] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:17:59.992746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.004464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955115a1-7650-4f37-86e6-1b3ca20aa5b0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.009769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa593d-7192-4a18-a4b1-18beb298f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.010433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa593d-7192-4a18-a4b1-18beb298f114 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.010715 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa593d-7192-4a18-a4b1-18beb298f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.010990 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa593d-7192-4a18-a4b1-18beb298f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.011765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa593d-7192-4a18-a4b1-18beb298f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.013458 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa593d-7192-4a18-a4b1-18beb298f114 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.023977 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1300/2636] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:00.028205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.038931 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327561-8c39-4bdb-8c1a-8cb262efa629 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.043712 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.044586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.044867 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.045144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] PATH_INFO: `/v3/projects/181644caf18442e5970349022d269b46/users/338a0697834e4051888bd9c0cb8413c8/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.060041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181644caf18442e5970349022d269b46, user_id=338a0697834e4051888bd9c0cb8413c8, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.062788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.110758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1337/2637] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:00 2022] PUT /identity/v3/projects/181644caf18442e5970349022d269b46/users/338a0697834e4051888bd9c0cb8413c8/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:00.122632 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.124500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.124500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.151376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] MFA Rules not processed for user `338a0697834e4051888bd9c0cb8413c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:00.152590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:00.217019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1301/2638] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:00.221631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.287837 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f8f3-dfbb-4ee3-9772-6a6fadf48f20 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.292874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.293539 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.293842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.294101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.294872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.296854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.381332 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1338/2639] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:18:00 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:18:00.385678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.397177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a45068-da53-49b2-b5c7-e90cda767855 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.407038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:00.454204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.454877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.455159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.455462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.456156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.458085 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.517217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1302/2640] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:18:00 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:18:00.521054 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.531530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a879161-27a8-42e0-ba1a-163271150735 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.536195 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.538699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.538699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.538699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.538699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.539796 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.550691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1339/2641] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:00.555104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.565761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ad1c-a057-45af-85c0-da23f59bf667 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.571273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.572196 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.572479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.572758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] PATH_INFO: `/v3/projects/99b2f55be78842f1b3272c60a6e13f60/users/378d0708d3424152b54c66f8239c3cec/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.587333 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b2f55be78842f1b3272c60a6e13f60, user_id=378d0708d3424152b54c66f8239c3cec, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.590014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.659737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1303/2642] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:00 2022] PUT /identity/v3/projects/99b2f55be78842f1b3272c60a6e13f60/users/378d0708d3424152b54c66f8239c3cec/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:00.663668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.673814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de3af2-5db6-445f-84aa-77de78d44fb4 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.731774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319f8c2-1f40-4469-b267-4ee5f01278e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.732473 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f8c2-1f40-4469-b267-4ee5f01278e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.732753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f8c2-1f40-4469-b267-4ee5f01278e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.733031 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f8c2-1f40-4469-b267-4ee5f01278e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.733748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319f8c2-1f40-4469-b267-4ee5f01278e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.735443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319f8c2-1f40-4469-b267-4ee5f01278e7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.746463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1340/2643] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:00.750665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.762205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3ee08-8c09-4afe-9fdf-c9433319c571 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.766854 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.767763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.768048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.768324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] PATH_INFO: `/v3/projects/99b2f55be78842f1b3272c60a6e13f60/users/378d0708d3424152b54c66f8239c3cec/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.770401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b2f55be78842f1b3272c60a6e13f60, user_id=378d0708d3424152b54c66f8239c3cec, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.773050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.783323 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1304/2644] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:00 2022] PUT /identity/v3/projects/99b2f55be78842f1b3272c60a6e13f60/users/378d0708d3424152b54c66f8239c3cec/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:00.793828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654e499-bafe-41c4-ba55-89c4c6a1c472 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.794123 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654e499-bafe-41c4-ba55-89c4c6a1c472 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.794403 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654e499-bafe-41c4-ba55-89c4c6a1c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.821036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c654e499-bafe-41c4-ba55-89c4c6a1c472 None None] MFA Rules not processed for user `378d0708d3424152b54c66f8239c3cec`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:00.822244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c654e499-bafe-41c4-ba55-89c4c6a1c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:00.831765 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:00.890101 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1341/2645] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:00.901339 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:00.903024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:00.965841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782dc5b-daa2-42c6-99a3-79a14cf08fd1 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:00.967630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:00.968283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:00.968575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:00.968851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:00.978541 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:00.980020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:00.990023 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1305/2646] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:00 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:01.707519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:01.708028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:01.708126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:01.727285 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] MFA Rules not processed for user `13e35a595b9646a28a26177eae068397`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:01.728551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:01.786376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1342/2647] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 2 09:18:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:01.798711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:01.800130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:01.808110 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:01.871763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aec3d-397f-4455-83be-0c6c4526db30 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:01.872518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5a37-0c33-40e0-91fa-7b14fbc8fbc1 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:01.876904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0db77b-246e-4580-a379-fec95ec01658 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b1d5f68be34afc8a72843e869bc3b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:01.877131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:01.877583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0db77b-246e-4580-a379-fec95ec01658 service swift] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:01.877867 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0db77b-246e-4580-a379-fec95ec01658 service swift] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:01.878068 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:01.878288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0db77b-246e-4580-a379-fec95ec01658 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:01.878407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:01.878577 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] PATH_INFO: `/v3/users/338a0697834e4051888bd9c0cb8413c8` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:01.879833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338a0697834e4051888bd9c0cb8413c8)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:01.881763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:01.886971 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0db77b-246e-4580-a379-fec95ec01658 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:01.888628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0db77b-246e-4580-a379-fec95ec01658 service swift] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:01.892277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:01.897847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1306/2648] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 2 09:18:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:18:02.004975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338a0697834e4051888bd9c0cb8413c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:02.010948 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:02.013439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338a0697834e4051888bd9c0cb8413c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:02.014137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338a0697834e4051888bd9c0cb8413c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:02.014773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338a0697834e4051888bd9c0cb8413c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:02.033548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338a0697834e4051888bd9c0cb8413c8'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:02.146365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1343/2649] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:18:01 2022] DELETE /identity/v3/users/338a0697834e4051888bd9c0cb8413c8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:18:02.154116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:02.154411 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:02.154692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:02.173080 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:02.185434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:02.239390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1307/2650] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:02.249030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:02.251377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:02.313621 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479de0d-bc46-4cbd-b976-50cd3e6c6446 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:02.317935 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:02.318591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:02.318870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:02.319141 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:02.335533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:02.335533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:02.346465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1344/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:18:02.907472 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:02.909824 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:02.946741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2780e-8120-42f9-b1ba-6f7b450595e3 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:02.953502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:02.955006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:02.955443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:02.955817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] PATH_INFO: `/v3/projects/181644caf18442e5970349022d269b46` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:02.957327 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=181644caf18442e5970349022d269b46)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:02.959484 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:03.067635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181644caf18442e5970349022d269b46', 'request_id': 'req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.074140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181644caf18442e5970349022d269b46', 'request_id': 'req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.163201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181644caf18442e5970349022d269b46', 'request_id': 'req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.175331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] The token cache is being invalidate because project 181644caf18442e5970349022d269b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:18:03.175895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.177097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.180108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1308/2652] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:18:02 2022] DELETE /identity/v3/projects/181644caf18442e5970349022d269b46 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:03.184404 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:03.194343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af58eaa-0e24-4a5f-9d7f-f0d6e410c971 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:03.257725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:03.258689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:03.258975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:03.259339 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] PATH_INFO: `/v3/users/378d0708d3424152b54c66f8239c3cec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:03.260853 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378d0708d3424152b54c66f8239c3cec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:03.262787 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:03.507917 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378d0708d3424152b54c66f8239c3cec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.515657 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378d0708d3424152b54c66f8239c3cec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.516361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378d0708d3424152b54c66f8239c3cec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.516963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378d0708d3424152b54c66f8239c3cec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.531296 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f8c8f5b6-8ba0-4714-bd6d-9becf5eff4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378d0708d3424152b54c66f8239c3cec'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:03.534251 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:03.605856 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1345/2653] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:18:03 2022] DELETE /identity/v3/users/378d0708d3424152b54c66f8239c3cec => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:04.144687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:04.153476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:04.173957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6ac1c-2d5d-4208-87c3-a033ad807d3d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:04.245807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:04.248510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:04.248883 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:04.249286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] PATH_INFO: `/v3/projects/99b2f55be78842f1b3272c60a6e13f60` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:04.250687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b2f55be78842f1b3272c60a6e13f60)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:04.252796 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:04.283569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:04.427167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b2f55be78842f1b3272c60a6e13f60', 'request_id': 'req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:04.434000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b2f55be78842f1b3272c60a6e13f60', 'request_id': 'req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:04.499895 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b2f55be78842f1b3272c60a6e13f60', 'request_id': 'req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:04.513523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] The token cache is being invalidate because project 99b2f55be78842f1b3272c60a6e13f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:18:04.513911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:04.514669 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-4e7b6dbe-1f6b-45aa-86a9-f3304732e0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:04.516306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1309/2654] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:18:04 2022] DELETE /identity/v3/projects/99b2f55be78842f1b3272c60a6e13f60 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:04.522322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:04.522798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:04.522956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:04.544478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:04.545733 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:04.616652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1346/2655] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:04.625888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:04.626330 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:04.626556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:04.646182 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:04.647464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:04.655930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1310/2656] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:18:04.660191 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:04.671576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f988b27-9296-4a66-9903-da689b573d68 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:04.676848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:04.677474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:04.681091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:04.681091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:04.681091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:18:04.681091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:04.681091 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:04.696336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1347/2657] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:18:04.697246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:04.708459 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358a5a3-5126-4435-9382-bc90a4ac7e9a None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:04.713836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:04.714912 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:04.715963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:04.715963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:04.716918 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:04.718562 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:04.827335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1311/2658] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:18:04 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:18:04.831462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:04.841774 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5484270-2dcd-49c0-91cd-bc7ffcab14db admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:04.902665 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:04.903592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:04.903877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:04.904155 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:04.904896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:04.906895 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:04.994940 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1348/2659] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:18:04 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:18:04.996194 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.006899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b16dbf-889a-4f1e-808d-6be3a8f124c8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.011936 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.012641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.012922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.013276 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.013931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.015576 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.026962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1312/2660] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:05.031085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.041932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7840-ece8-4d48-8056-54a1ba720765 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.056730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e370b-b9ae-4c1f-932e-b5d8fb7541a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.056730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e370b-b9ae-4c1f-932e-b5d8fb7541a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.056730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e370b-b9ae-4c1f-932e-b5d8fb7541a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.056730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e370b-b9ae-4c1f-932e-b5d8fb7541a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.057159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e370b-b9ae-4c1f-932e-b5d8fb7541a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.057159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e370b-b9ae-4c1f-932e-b5d8fb7541a5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.061131 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1349/2661] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:05.065168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.076753 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7152c1-bc46-4419-9382-c72c013b8a5e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.083066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.084002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.084285 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.084560 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] PATH_INFO: `/v3/projects/8502d747803843ae991438a435876cc6/users/121587442c1a462d8152feabdae69c2f/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.101256 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8502d747803843ae991438a435876cc6, user_id=121587442c1a462d8152feabdae69c2f, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.104119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.179596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1313/2662] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:05 2022] PUT /identity/v3/projects/8502d747803843ae991438a435876cc6/users/121587442c1a462d8152feabdae69c2f/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:05.189661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.189956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.190238 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.216936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] MFA Rules not processed for user `121587442c1a462d8152feabdae69c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:05.218086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:05.265506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:05.283045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1350/2663] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:05.288040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.349394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015f358-36da-4a25-96fe-f207c087e32a admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.354187 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.354889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.355168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.355462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.356204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.358160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.435303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1314/2664] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:18:05 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:18:05.439315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.450843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693444-1cf4-488d-9fae-bcee68df70cf None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.520744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.521454 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.521739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.522017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.522744 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.524681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.635821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1351/2665] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:18:05 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:18:05.637052 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.648280 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c83bd-b74f-46c9-a81c-43765cfef033 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.653027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.653699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.654010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.654286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.655022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.656667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.667351 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1315/2666] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:18:05.671513 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.682064 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d303be7-f22d-4604-84ab-07dabc1a7bc3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.686753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.687679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.687969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.688248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] PATH_INFO: `/v3/projects/110d28874919445d9756485dcdefcb16/users/b249cde82e2740729b0cc7d7e6f84e4f/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.703982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110d28874919445d9756485dcdefcb16, user_id=b249cde82e2740729b0cc7d7e6f84e4f, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.706638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.791111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1352/2667] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:05 2022] PUT /identity/v3/projects/110d28874919445d9756485dcdefcb16/users/b249cde82e2740729b0cc7d7e6f84e4f/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:05.795112 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.805553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95babd-b3a1-4de8-a9da-b6d8895fd20d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.824124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:05.860342 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119605e-2e59-4e83-bd7f-f5acbf963bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.861012 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119605e-2e59-4e83-bd7f-f5acbf963bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.861302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119605e-2e59-4e83-bd7f-f5acbf963bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.861595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119605e-2e59-4e83-bd7f-f5acbf963bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.862316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119605e-2e59-4e83-bd7f-f5acbf963bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.864471 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119605e-2e59-4e83-bd7f-f5acbf963bf4 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.874861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1316/2668] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:05.878966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:05.890159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5c49-57c7-46da-aa0a-3bcd71edce68 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:05.894818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:05.895730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.896037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.896315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] PATH_INFO: `/v3/projects/110d28874919445d9756485dcdefcb16/users/b249cde82e2740729b0cc7d7e6f84e4f/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.898247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110d28874919445d9756485dcdefcb16, user_id=b249cde82e2740729b0cc7d7e6f84e4f, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:05.900900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:05.910956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1353/2669] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:05 2022] PUT /identity/v3/projects/110d28874919445d9756485dcdefcb16/users/b249cde82e2740729b0cc7d7e6f84e4f/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:05.920893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:05.921269 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:05.921623 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:05.949638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] MFA Rules not processed for user `b249cde82e2740729b0cc7d7e6f84e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:05.951653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:06.017836 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1317/2670] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:06.028877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:06.030561 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:06.086639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d3a25-6a51-457f-bab4-023e3c1a8c40 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:06.090281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:06.090919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:06.091204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:06.091528 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:06.145028 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:06.147206 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:06.148693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:06.157401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1354/2671] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:12.310118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:12.316167 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:12.324423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd9a89-d13f-40ac-b998-5c8c8a30079f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:12.328260 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:12.328917 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:12.329203 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:12.329480 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:12.339397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:12.340821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:12.350525 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1318/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:16.207936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=2 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:22.345992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=59 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:23.789750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:23.791193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:23.847134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e311e22-13b3-4ee4-97b4-cdbfea57fd9d service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:23.851423 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:23.852065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:23.852346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:23.852622 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:23.854348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:23.915056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:23.916603 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fbd8-5d24-4b40-b778-7048d235ba28 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:23.929126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1355/2673] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:33.921828 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=50 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:39.028164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:39.092222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e6151-4473-459a-a272-c293feb64e40 service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:39.096696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:39.097558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:39.097866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:39.098138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] PATH_INFO: `/v3/users/121587442c1a462d8152feabdae69c2f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:39.099507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121587442c1a462d8152feabdae69c2f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:39.103607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:39.271906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121587442c1a462d8152feabdae69c2f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:39.278700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121587442c1a462d8152feabdae69c2f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:39.279385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121587442c1a462d8152feabdae69c2f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:39.279987 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121587442c1a462d8152feabdae69c2f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:39.291972 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121587442c1a462d8152feabdae69c2f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:39.354865 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1319/2674] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:18:39 2022] DELETE /identity/v3/users/121587442c1a462d8152feabdae69c2f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:39.359556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:39.360036 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:39.360143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:39.377526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:39.378705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:39.436545 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1356/2675] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:18:39.446664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:39.448078 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:39.503030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3e68-0b89-45b4-ad8d-9f11deb40cd6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:39.507172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:39.507834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:39.508115 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:39.508390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:39.518101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:39.519549 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:39.528852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1320/2676] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:39.911508 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:39.912985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:39.927833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1991b51-862e-4904-9198-5d467bb2558b None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:39.932651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:39.933526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:39.933814 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:39.934109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] PATH_INFO: `/v3/projects/8502d747803843ae991438a435876cc6` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:39.935315 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8502d747803843ae991438a435876cc6)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:39.937299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:40.034943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8502d747803843ae991438a435876cc6', 'request_id': 'req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.041602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8502d747803843ae991438a435876cc6', 'request_id': 'req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.126609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8502d747803843ae991438a435876cc6', 'request_id': 'req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.137562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] The token cache is being invalidate because project 8502d747803843ae991438a435876cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:18:40.137850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.138465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.140042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1357/2677] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:18:39 2022] DELETE /identity/v3/projects/8502d747803843ae991438a435876cc6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:40.144019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:40.154263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ae962-a0cc-4b60-ba1b-a88793ffce3d service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:40.173001 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:40.210463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:40.211380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:40.211663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:40.211943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] PATH_INFO: `/v3/users/b249cde82e2740729b0cc7d7e6f84e4f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:40.213126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b249cde82e2740729b0cc7d7e6f84e4f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:40.215032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:40.420554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b249cde82e2740729b0cc7d7e6f84e4f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.427306 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b249cde82e2740729b0cc7d7e6f84e4f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.427967 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b249cde82e2740729b0cc7d7e6f84e4f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.428601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b249cde82e2740729b0cc7d7e6f84e4f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.440313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-9a18d942-e96a-4f77-b640-db332767163a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b249cde82e2740729b0cc7d7e6f84e4f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:40.521049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1321/2678] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:18:40 2022] DELETE /identity/v3/users/b249cde82e2740729b0cc7d7e6f84e4f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:40.899778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:40.901245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:40.914220 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f8b7-7b79-4601-b610-d5b6ff98cc24 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:40.975624 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:40.976413 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:40.976697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:40.976970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] PATH_INFO: `/v3/projects/110d28874919445d9756485dcdefcb16` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:40.978143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=110d28874919445d9756485dcdefcb16)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:40.980089 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.047849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:41.063929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110d28874919445d9756485dcdefcb16', 'request_id': 'req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:41.070769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110d28874919445d9756485dcdefcb16', 'request_id': 'req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:41.160562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110d28874919445d9756485dcdefcb16', 'request_id': 'req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:41.171120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] The token cache is being invalidate because project 110d28874919445d9756485dcdefcb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:18:41.171447 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:41.172331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ab4f265e-efc8-4526-b8c7-edcf2ad9c98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:41.174205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1358/2679] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:18:40 2022] DELETE /identity/v3/projects/110d28874919445d9756485dcdefcb16 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:41.179606 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.180103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.180210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.198593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:41.199923 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:41.258622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1322/2680] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:18:41.266507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.266802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.267088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.284906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:41.286132 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:41.295428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1359/2681] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:41.299429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.309530 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207643c4-3683-418e-8f56-ed6e5dd70abb None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.314117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.314762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.315044 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.315355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.316075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:18:41.316381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.317963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.329678 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1323/2682] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:18:41.333783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.342807 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7219-31d6-44d1-927c-ea93a8608c73 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.347346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.347982 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.348262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.348534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.349210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.351649 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.447966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1360/2683] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:18:41 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:18:41.452091 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.462072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c98e7-d7fe-4dc6-9839-e477d9599753 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.487763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:41.517399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.518005 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.518289 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.518595 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.519311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.521513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.641517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1324/2684] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:18:41 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:18:41.645399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.656163 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ec67b-ad15-43f7-88a4-ece087467bea admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.660806 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.661464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.661749 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.662022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.663496 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.667961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.675488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1361/2685] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:41.679697 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.689561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6c16-7015-49f1-8400-bbc9504e22e1 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.694157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44911738-26a2-461c-8114-ff3108748ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.694811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44911738-26a2-461c-8114-ff3108748ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.695099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44911738-26a2-461c-8114-ff3108748ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.695414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44911738-26a2-461c-8114-ff3108748ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.696139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44911738-26a2-461c-8114-ff3108748ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.697739 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44911738-26a2-461c-8114-ff3108748ea0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.707594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1325/2686] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:41.711914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.721532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112ea0-0b8b-4511-9090-8d4723fb7512 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.726636 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.727531 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.727817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.728095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] PATH_INFO: `/v3/projects/32df9c3a4afc4ffcb8c228eefca09e7e/users/20146f03400c4d2d9c5b23a3ad82f8dd/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.742187 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32df9c3a4afc4ffcb8c228eefca09e7e, user_id=20146f03400c4d2d9c5b23a3ad82f8dd, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.744882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:41.812314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1362/2687] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:41 2022] PUT /identity/v3/projects/32df9c3a4afc4ffcb8c228eefca09e7e/users/20146f03400c4d2d9c5b23a3ad82f8dd/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:41.822245 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.822540 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.822951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.849477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] MFA Rules not processed for user `20146f03400c4d2d9c5b23a3ad82f8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:41.850716 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:41.913097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1326/2688] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:41.924727 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:41.926462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:41.982337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3e6e-26b3-4083-a47f-a3c15b002df1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:41.985943 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e5824-9b03-43cd-ae09-43ffb9ea23ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:41.986586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e5824-9b03-43cd-ae09-43ffb9ea23ff service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:41.986871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e5824-9b03-43cd-ae09-43ffb9ea23ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:41.987146 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e5824-9b03-43cd-ae09-43ffb9ea23ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:41.995383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e5824-9b03-43cd-ae09-43ffb9ea23ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:41.996804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e5824-9b03-43cd-ae09-43ffb9ea23ff service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:42.005471 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1363/2689] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:45.792019 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:45.854426 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbef17-9731-4475-a37f-1655c3d5de28 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:45.858951 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:45.859864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:45.860153 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:45.860433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] PATH_INFO: `/v3/users/20146f03400c4d2d9c5b23a3ad82f8dd` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:45.861630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20146f03400c4d2d9c5b23a3ad82f8dd)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:45.863603 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:46.065630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:46.071483 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20146f03400c4d2d9c5b23a3ad82f8dd'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:46.078523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20146f03400c4d2d9c5b23a3ad82f8dd'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:46.079226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20146f03400c4d2d9c5b23a3ad82f8dd'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:46.079848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20146f03400c4d2d9c5b23a3ad82f8dd'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:46.092643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20146f03400c4d2d9c5b23a3ad82f8dd'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:46.201157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1327/2690] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:18:45 2022] DELETE /identity/v3/users/20146f03400c4d2d9c5b23a3ad82f8dd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:46.205763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:46.206266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:46.206383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:46.224685 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:46.226489 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:46.279081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:46.295526 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1364/2691] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:46.305305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:46.306811 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:46.377637 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876fbc-3ac6-4e94-9834-d2d351b038b6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:46.381509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e670c-9b49-476a-a881-14ea4142b03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:46.383537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e670c-9b49-476a-a881-14ea4142b03a service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:46.383829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e670c-9b49-476a-a881-14ea4142b03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:46.384593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e670c-9b49-476a-a881-14ea4142b03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:46.400084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e670c-9b49-476a-a881-14ea4142b03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:46.400084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e670c-9b49-476a-a881-14ea4142b03a service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:46.407818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1328/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:46.848463 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:46.850239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:46.865584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6772-e3f3-4ab7-9fe8-775266df5a03 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:46.871202 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:46.872214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:46.872501 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:46.872784 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] PATH_INFO: `/v3/projects/32df9c3a4afc4ffcb8c228eefca09e7e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:46.874124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32df9c3a4afc4ffcb8c228eefca09e7e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:46.876016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:46.985092 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32df9c3a4afc4ffcb8c228eefca09e7e', 'request_id': 'req-367d4de4-4766-40f5-99dc-6923d681ddd9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:46.992174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32df9c3a4afc4ffcb8c228eefca09e7e', 'request_id': 'req-367d4de4-4766-40f5-99dc-6923d681ddd9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:47.063863 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32df9c3a4afc4ffcb8c228eefca09e7e', 'request_id': 'req-367d4de4-4766-40f5-99dc-6923d681ddd9'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:47.076050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] The token cache is being invalidate because project 32df9c3a4afc4ffcb8c228eefca09e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:18:47.076439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:47.077167 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-367d4de4-4766-40f5-99dc-6923d681ddd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:47.078909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1365/2693] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:18:46 2022] DELETE /identity/v3/projects/32df9c3a4afc4ffcb8c228eefca09e7e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:47.084646 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.085263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.085363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.104206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:47.105447 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:47.168692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1329/2694] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:47.177319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.177732 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.178084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.199584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:47.200831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:47.208950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1366/2695] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:18:47.213163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.228587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51ff2e-05c7-41c5-9b47-97c7762e7007 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.233848 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.235074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.235461 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.235803 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.236600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:18:47.236970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.238645 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.251518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1330/2696] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:18:47.256107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.266558 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0255-9136-4664-aeed-d0a8a1001871 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.271416 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.272111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.272371 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.272731 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.273470 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.275406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.373479 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1367/2697] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:18:47 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:18:47.374136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.386146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb70f5-4d1c-4e2e-aec2-bb3e6895f0ec admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.467727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:47.483783 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.484469 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.484756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.485036 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.485813 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.487706 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.596563 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1331/2698] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:18:47 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:18:47.601586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.612769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b043d-5657-4f51-9cda-dac5e69c24bc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.617645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.619427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.619427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.619427 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.619709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.621326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.632109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1368/2699] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:47.636577 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.647298 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b211c-2b2b-4eb6-b6e5-4baabc6cfb65 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.652684 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2639c0-7ee7-4420-9fba-b04e94b94537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.653371 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2639c0-7ee7-4420-9fba-b04e94b94537 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.653671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2639c0-7ee7-4420-9fba-b04e94b94537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.653940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2639c0-7ee7-4420-9fba-b04e94b94537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.654703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2639c0-7ee7-4420-9fba-b04e94b94537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.656363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2639c0-7ee7-4420-9fba-b04e94b94537 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.668761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1332/2700] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:47.673288 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.683929 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65adc88-c501-4483-9bfb-942a69c4f94a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.688804 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.689646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.689932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.690212 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] PATH_INFO: `/v3/projects/a42f61cb61984cecb6289ff4358c74ec/users/c2cce5712afa4bfda2388221f924e1e0/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.704858 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42f61cb61984cecb6289ff4358c74ec, user_id=c2cce5712afa4bfda2388221f924e1e0, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.707536 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.766402 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1369/2701] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:47 2022] PUT /identity/v3/projects/a42f61cb61984cecb6289ff4358c74ec/users/c2cce5712afa4bfda2388221f924e1e0/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:47.777050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.777350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.777633 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.803930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] MFA Rules not processed for user `c2cce5712afa4bfda2388221f924e1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:47.805146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:47.867730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1333/2702] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:47.879379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:47.881082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:47.946942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b2e4c-caec-444c-b0b2-b971513ebbd3 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:47.950634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:47.951318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:47.951606 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:47.952021 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:47.961305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:47.962719 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:47.971830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1370/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:51.978234 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:51.979733 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:52.036564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c5d4-a9d6-4089-87b8-4c7dfe812ead None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:52.040687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:52.041344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:52.041630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:52.041907 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:52.043786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:52.108328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:52.119122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:52.119652 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1334/2704] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:18:55.778819 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:55.780737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:55.800698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757881d-ad7e-42a7-bd1f-eae7d9a20944 service glance] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:55.805414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:55.806308 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:55.806595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:55.806874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] PATH_INFO: `/v3/users/58b706e007fa46c7b8a69508455fcdba` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:55.808156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b706e007fa46c7b8a69508455fcdba)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:55.810336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:55.821354 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:55.994107 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b706e007fa46c7b8a69508455fcdba'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.002029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b706e007fa46c7b8a69508455fcdba'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.002767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b706e007fa46c7b8a69508455fcdba'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.003418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b706e007fa46c7b8a69508455fcdba'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.017162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e96f9421-8dc2-49f5-9ff8-4a47e68a8edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b706e007fa46c7b8a69508455fcdba'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.087730 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1371/2705] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:18:55 2022] DELETE /identity/v3/users/58b706e007fa46c7b8a69508455fcdba => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:18:56.375812 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:56.382060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:56.386932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfebb6e-dee9-4203-9572-e481b2ec3f8e service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:56.449679 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:56.450647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:56.450927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:56.451202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] PATH_INFO: `/v3/projects/24a81b035f834106b49c35c847f246d6` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:56.452435 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a81b035f834106b49c35c847f246d6)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:56.454320 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:56.556126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a81b035f834106b49c35c847f246d6', 'request_id': 'req-551752ec-9739-4ca4-a083-141f62198c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.562311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a81b035f834106b49c35c847f246d6', 'request_id': 'req-551752ec-9739-4ca4-a083-141f62198c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.606240 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a81b035f834106b49c35c847f246d6', 'request_id': 'req-551752ec-9739-4ca4-a083-141f62198c21'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.617579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] The token cache is being invalidate because project 24a81b035f834106b49c35c847f246d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:18:56.617862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.618500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-551752ec-9739-4ca4-a083-141f62198c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:18:56.620067 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1335/2706] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:18:56 2022] DELETE /identity/v3/projects/24a81b035f834106b49c35c847f246d6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:56.625011 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:56.625305 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:56.625613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:56.643879 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:56.645042 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:56.706003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1372/2707] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:56.714481 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:56.714788 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:56.715045 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:56.734948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:56.736199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:56.744390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1336/2708] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:56.748725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:56.758525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c148145-3266-4844-bda8-f0ccf4413140 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:56.763365 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:56.764035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:56.764320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:56.764598 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:56.765337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:18:56.765646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:56.767274 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:56.779904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1373/2709] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:18:56.784781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:56.794805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c44b7-78ab-4822-b45b-61fa4e22ab16 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:56.799518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:56.800175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:56.800517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:56.800798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:56.801491 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:56.803409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:56.865162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1337/2710] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:18:56 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:18:56.869398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:56.879722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bb49b-ccf8-4e62-87f5-a9c35e857361 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:56.938916 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:56.939638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:56.939928 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:56.940208 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:56.940930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:56.942860 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:57.028638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1374/2711] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:18:56 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:18:57.029945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:57.040519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9379a3-02d9-4a12-a86b-d02115a493b7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:57.045433 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:57.046103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:57.046392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:57.046671 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:57.047439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:57.049034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:57.063027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1338/2712] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:18:57.067169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:57.074074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:57.077683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd02bb-1051-46f9-9c15-dac7354777ab admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:57.082316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b9fb7-f89c-4d01-bff5-bee1fe446811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:57.084197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b9fb7-f89c-4d01-bff5-bee1fe446811 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:57.084197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b9fb7-f89c-4d01-bff5-bee1fe446811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:57.084197 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b9fb7-f89c-4d01-bff5-bee1fe446811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:57.084460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b9fb7-f89c-4d01-bff5-bee1fe446811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:57.085848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b9fb7-f89c-4d01-bff5-bee1fe446811 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:57.097571 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1375/2713] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:18:57.101537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:57.112314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e9139-1f3f-4acf-9f2a-54bf2a640c8f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:57.117609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:57.119582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:57.119874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:57.120154 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] PATH_INFO: `/v3/projects/8a9d7d82538e45f7a021dd27b6203f9a/users/7fec67e95dbe4394a1ae15469f2a282f/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:57.136349 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9d7d82538e45f7a021dd27b6203f9a, user_id=7fec67e95dbe4394a1ae15469f2a282f, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:57.139046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:57.207324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1339/2714] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:18:57 2022] PUT /identity/v3/projects/8a9d7d82538e45f7a021dd27b6203f9a/users/7fec67e95dbe4394a1ae15469f2a282f/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:18:57.214104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b45a5-7fa8-4a08-b088-0b96436e1cf7 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:57.214394 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b45a5-7fa8-4a08-b088-0b96436e1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:57.214673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b45a5-7fa8-4a08-b088-0b96436e1cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:57.231701 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f93b45a5-7fa8-4a08-b088-0b96436e1cf7 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:18:57.232886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f93b45a5-7fa8-4a08-b088-0b96436e1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:57.291214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1376/2715] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:18:57.300830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:18:57.302502 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:18:57.337470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:57.359860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f1f3-a39d-4222-9c20-0a6da8420507 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:18:57.366651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:18:57.366651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:18:57.366651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:18:57.366651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:18:57.373964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:18:57.375437 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:18:57.386104 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1340/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:19:02.673639 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f979c2-2b9c-42b0-b3a3-c7c608d1f145 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:02.674143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f979c2-2b9c-42b0-b3a3-c7c608d1f145 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:02.674254 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f979c2-2b9c-42b0-b3a3-c7c608d1f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:02.704286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d7f979c2-2b9c-42b0-b3a3-c7c608d1f145 None None] MFA Rules not processed for user `7fec67e95dbe4394a1ae15469f2a282f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:02.705660 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d7f979c2-2b9c-42b0-b3a3-c7c608d1f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:02.772679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1377/2717] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:19:02.789945 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:02.791592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:02.866736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d5767-16ac-4593-af63-4ec83cd86daf service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:02.872149 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:02.872795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:02.873101 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:02.873376 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:02.881000 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:02.883746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:02.892076 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1341/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:19:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:19:05.321537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f3e4-67de-4c44-ad75-70f9d9bbbe6a None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:05.322098 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f3e4-67de-4c44-ad75-70f9d9bbbe6a None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:05.322186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f3e4-67de-4c44-ad75-70f9d9bbbe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:05.341151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-4502f3e4-67de-4c44-ad75-70f9d9bbbe6a None None] MFA Rules not processed for user `7fec67e95dbe4394a1ae15469f2a282f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:05.342376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-4502f3e4-67de-4c44-ad75-70f9d9bbbe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:05.349445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1378/2719] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:19:12.888090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=46 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:15.336078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=65 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:23.205817 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:23.207423 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:23.221226 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e88a3-a231-42df-9dae-ed6fdb6831d2 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:23.225929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:23.226809 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:23.227958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:23.231758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] PATH_INFO: `/v3/users/c2cce5712afa4bfda2388221f924e1e0` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:23.234887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cce5712afa4bfda2388221f924e1e0)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:23.237259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:23.426316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cce5712afa4bfda2388221f924e1e0'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:23.433777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cce5712afa4bfda2388221f924e1e0'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:23.434445 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cce5712afa4bfda2388221f924e1e0'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:23.435054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cce5712afa4bfda2388221f924e1e0'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:23.447564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cce5712afa4bfda2388221f924e1e0'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:23.526441 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1342/2720] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:19:23 2022] DELETE /identity/v3/users/c2cce5712afa4bfda2388221f924e1e0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:19:23.531135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:23.531644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:23.531753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:23.550695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:23.551094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:23.610889 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1379/2721] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:19:23.621135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:23.622962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:23.681274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269292bc-7cdf-4054-aa3a-7fcaa1febdfb admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:23.684921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea81682-2ced-4247-9f47-4debcb15a06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:23.685569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81682-2ced-4247-9f47-4debcb15a06a service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:23.685855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81682-2ced-4247-9f47-4debcb15a06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:23.686135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81682-2ced-4247-9f47-4debcb15a06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:23.695155 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea81682-2ced-4247-9f47-4debcb15a06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:23.699762 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea81682-2ced-4247-9f47-4debcb15a06a service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:23.705927 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1343/2722] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:19:24.098630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.100095 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:24.112842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808760-1c38-4d97-aa2b-49d6c0548545 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.117442 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.118368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.118655 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.118932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] PATH_INFO: `/v3/projects/a42f61cb61984cecb6289ff4358c74ec` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.120196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42f61cb61984cecb6289ff4358c74ec)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.122125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.247997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42f61cb61984cecb6289ff4358c74ec', 'request_id': 'req-5fd082f6-92f1-43a4-96d8-5be340ba2d86'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:24.254154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42f61cb61984cecb6289ff4358c74ec', 'request_id': 'req-5fd082f6-92f1-43a4-96d8-5be340ba2d86'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:24.313642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42f61cb61984cecb6289ff4358c74ec', 'request_id': 'req-5fd082f6-92f1-43a4-96d8-5be340ba2d86'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:24.324711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] The token cache is being invalidate because project a42f61cb61984cecb6289ff4358c74ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:19:24.328925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:24.328925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5fd082f6-92f1-43a4-96d8-5be340ba2d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:24.328925 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1380/2723] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:19:24 2022] DELETE /identity/v3/projects/a42f61cb61984cecb6289ff4358c74ec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:19:24.332135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.332626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.332744 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.349954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:24.351197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:24.412597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1344/2724] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:19:24.421346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.421642 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.421927 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.440817 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:24.442037 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:24.450722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1381/2725] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:19:24.454978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.464653 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aa699-2c62-4969-9ed1-b4c789f5298d None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.469107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.469755 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.470038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.470312 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.471028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:19:24.471369 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.472975 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.484120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1345/2726] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:19:24.488218 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.497820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331173ad-5b67-46d3-8526-eb210d6dcd5c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.502506 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.503151 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.503464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.503746 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.504449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.506320 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.629537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1382/2727] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:19:24 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:19:24.634015 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.639084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:24.644417 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbaf363-b127-4ddf-a930-8c4f4f4b8145 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.699857 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.700452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.700734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.701009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.701707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.703663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.765746 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1346/2728] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:19:24 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:19:24.769808 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.779909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d111-2526-4619-a9f5-2e7a4f859459 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.784654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.785286 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.785575 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.785847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.786569 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.788256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.798942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1383/2729] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:19:24.802818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.813329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5def90-43c7-4bd2-8039-01651b880d2f admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.817939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431659d-c8c4-45ee-946b-87559683df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.818589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431659d-c8c4-45ee-946b-87559683df84 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.818874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431659d-c8c4-45ee-946b-87559683df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.819151 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431659d-c8c4-45ee-946b-87559683df84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.819905 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431659d-c8c4-45ee-946b-87559683df84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.821533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431659d-c8c4-45ee-946b-87559683df84 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.831284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1347/2730] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:19:24.835058 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:24.844789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcfb7e-ffda-4ea1-82f1-c49eabf76d24 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:24.849369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:24.850239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.850525 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.850800 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] PATH_INFO: `/v3/projects/16df36f2f2524cca95ef8aaa9886754c/users/fd5ab0c65b964a87ab1e980f6c93eb6c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.866361 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=16df36f2f2524cca95ef8aaa9886754c, user_id=fd5ab0c65b964a87ab1e980f6c93eb6c, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:24.869683 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:24.921260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1384/2731] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:19:24 2022] PUT /identity/v3/projects/16df36f2f2524cca95ef8aaa9886754c/users/fd5ab0c65b964a87ab1e980f6c93eb6c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:19:24.932332 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:24.932627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:24.932904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:24.958999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] MFA Rules not processed for user `fd5ab0c65b964a87ab1e980f6c93eb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:24.960156 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:25.022724 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1348/2732] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:19:25.034338 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:25.036056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:25.058050 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:25.092001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d45e-7ddc-4195-8ca8-570698a9f3be admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:25.095625 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a41ec-c364-459a-b59f-f06e6c75c003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:25.096762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a41ec-c364-459a-b59f-f06e6c75c003 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:25.096762 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a41ec-c364-459a-b59f-f06e6c75c003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:25.096944 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a41ec-c364-459a-b59f-f06e6c75c003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:25.105486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a41ec-c364-459a-b59f-f06e6c75c003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:25.106932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a41ec-c364-459a-b59f-f06e6c75c003 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:25.116120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1385/2733] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:19:25.140634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:25.205689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b656f5-eb8a-4226-8fe0-e22c02f7fb05 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:25.210738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:25.212120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:25.212400 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:25.212673 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] PATH_INFO: `/v3/users/fd5ab0c65b964a87ab1e980f6c93eb6c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:25.213916 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5ab0c65b964a87ab1e980f6c93eb6c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:25.215893 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:25.229207 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:25.355685 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5ab0c65b964a87ab1e980f6c93eb6c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:25.362493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5ab0c65b964a87ab1e980f6c93eb6c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:25.363242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5ab0c65b964a87ab1e980f6c93eb6c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:25.363904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5ab0c65b964a87ab1e980f6c93eb6c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:25.375985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5ab0c65b964a87ab1e980f6c93eb6c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:25.439204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1349/2734] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:19:25 2022] DELETE /identity/v3/users/fd5ab0c65b964a87ab1e980f6c93eb6c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:19:25.443844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:25.444262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:25.449271 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:25.462359 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:19:25.463519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:25.521757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1386/2735] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:19:25.531986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:25.533425 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:25.589292 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a727b-24d1-4591-a90c-ca1e5ec3c42d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:25.592929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:25.593572 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:25.593856 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:25.594137 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:25.603046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:25.604497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:25.613777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1350/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:19:25.965554 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:19:25.967019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:19:25.978957 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210898-a9d4-4af9-bf6a-6ea1bb81cd38 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:19:25.983716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:19:25.984585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:19:25.984866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:19:25.985144 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] PATH_INFO: `/v3/projects/16df36f2f2524cca95ef8aaa9886754c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:19:25.986321 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16df36f2f2524cca95ef8aaa9886754c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:19:25.997906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:19:26.085693 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16df36f2f2524cca95ef8aaa9886754c', 'request_id': 'req-da224882-843f-4533-a82d-6db013a9c61d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:26.091688 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16df36f2f2524cca95ef8aaa9886754c', 'request_id': 'req-da224882-843f-4533-a82d-6db013a9c61d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:26.182353 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16df36f2f2524cca95ef8aaa9886754c', 'request_id': 'req-da224882-843f-4533-a82d-6db013a9c61d'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:26.193104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] The token cache is being invalidate because project 16df36f2f2524cca95ef8aaa9886754c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:19:26.193392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:26.194001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-da224882-843f-4533-a82d-6db013a9c61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:19:26.195570 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1387/2737] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:19:25 2022] DELETE /identity/v3/projects/16df36f2f2524cca95ef8aaa9886754c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:19:35.609628 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:36.189947 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:08.265410 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:20:08.268123 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:20:08.336529 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054008dd-0ebb-4e2c-8b38-0a98da1e20af service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:20:08.399038 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:20:08.399736 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:20:08.400026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:20:08.400308 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:20:08.402148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:20:08.413767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:20:08.416597 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:20:08.425722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1351/2738] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:20:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:20:11.479679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:20:11.480166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:20:11.480272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:20:11.498920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] MFA Rules not processed for user `7fec67e95dbe4394a1ae15469f2a282f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:20:11.500074 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:20:11.553248 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1388/2739] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:20:18.421236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=58 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:21.546592 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=25 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:07.039265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:21:07.040699 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:07.099519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4ddb-79e9-40bd-bc74-052f1bc34d70 service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:21:07.103082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:21:07.103768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:21:07.104054 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:21:07.104331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:21:07.106082 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:07.182662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:21:07.184734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e6acb-d6d1-482b-8c15-7a852d2b00b4 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:21:07.195791 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1352/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:21:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:21:08.779721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:21:08.781126 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:08.836387 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6202c23-cd8c-4fd3-837e-f0a22f14d2f0 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:21:08.840041 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:21:08.840709 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:21:08.840991 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:21:08.841266 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:21:08.843069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:08.856805 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:21:08.858231 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:21:08.868908 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1389/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:21:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:21:17.190801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=54 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:18.864133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=26 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:24.735243 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:21:24.735949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:21:24.735949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:21:24.753127 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] MFA Rules not processed for user `7fec67e95dbe4394a1ae15469f2a282f`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:21:24.754316 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:24.761501 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1353/2742] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:21:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:21:34.748291 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:38.455563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:21:38.456850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:38.470276 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a47a-8a9e-41a3-af21-b02270d4d02a service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:21:38.475937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:21:38.477185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:21:38.477185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:21:38.477185 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:21:38.478950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:21:38.491451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:21:38.493976 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:21:38.504357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1390/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:21:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:21:48.499851 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:12.627860 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:12.637758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565f4-e208-46fe-89e2-dbf9a360cdc6 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:12.641357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:12.642003 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:12.642302 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:12.642583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:12.644385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:12.653818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:12.655257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:12.663160 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1354/2744] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:22.534942 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:22.544376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b7b57-9f64-4650-9202-69bf1fb5b715 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:22.547986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:22.548623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:22.548905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:22.549194 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:22.550921 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:22.613372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:22.615723 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:22.627053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1391/2745] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:22.659647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:26.240929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:26.242583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:26.258771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccda6b-b153-4505-be7f-bb77424bea6f service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:26.264193 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:26.265006 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:26.265396 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:26.265772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:26.267910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:26.281265 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:26.282949 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:26.300691 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1355/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:30.483261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:30.484854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:30.500827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee2bb-b7c2-4939-a0ee-8583ad46c288 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:30.506059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:30.507820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:30.509193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:30.509193 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] PATH_INFO: `/v3/users/5d38aab25eca47c888d3add258ce3cff` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:30.509779 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d38aab25eca47c888d3add258ce3cff)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:30.511811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:30.683562 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d38aab25eca47c888d3add258ce3cff'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:30.691579 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d38aab25eca47c888d3add258ce3cff'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:30.692295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d38aab25eca47c888d3add258ce3cff'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:30.693069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d38aab25eca47c888d3add258ce3cff'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:30.706392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d38aab25eca47c888d3add258ce3cff'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:30.760595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1392/2747] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:22:30 2022] DELETE /identity/v3/users/5d38aab25eca47c888d3add258ce3cff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:22:31.075814 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:31.086891 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca52db9-6948-431f-80d4-c7fdc5003c0b service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:31.147365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:31.148247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:31.148565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:31.148871 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] PATH_INFO: `/v3/projects/5ec06218a20940509976a1e656176d9b` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:31.150059 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec06218a20940509976a1e656176d9b)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:31.152049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:31.252486 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec06218a20940509976a1e656176d9b', 'request_id': 'req-682183bc-f18b-4426-b569-ca431285aa1b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.258954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec06218a20940509976a1e656176d9b', 'request_id': 'req-682183bc-f18b-4426-b569-ca431285aa1b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.343503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec06218a20940509976a1e656176d9b', 'request_id': 'req-682183bc-f18b-4426-b569-ca431285aa1b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.354385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] The token cache is being invalidate because project 5ec06218a20940509976a1e656176d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:22:31.354680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.355350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.357011 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1356/2748] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:22:31 2022] DELETE /identity/v3/projects/5ec06218a20940509976a1e656176d9b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:22:31.360936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:31.362369 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:31.376422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e055-1f96-4c53-b546-eb974cbf4b5c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:31.436872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:31.437758 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:31.438044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:31.438330 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] PATH_INFO: `/v3/users/bc403a28446e4869b4ae1580ae9386a1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:31.439640 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc403a28446e4869b4ae1580ae9386a1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:31.441566 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:31.446911 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:31.636838 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc403a28446e4869b4ae1580ae9386a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.644389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc403a28446e4869b4ae1580ae9386a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.645487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc403a28446e4869b4ae1580ae9386a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.646612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc403a28446e4869b4ae1580ae9386a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.659003 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d7116577-a059-4af9-b063-f7f0092672b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc403a28446e4869b4ae1580ae9386a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:31.726267 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1393/2749] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:22:31 2022] DELETE /identity/v3/users/bc403a28446e4869b4ae1580ae9386a1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:22:32.019066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.020664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:32.038700 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682183bc-f18b-4426-b569-ca431285aa1b admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.108536 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.109477 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.109768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.110048 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] PATH_INFO: `/v3/projects/d62e8b3c889a4a7d9ad49802644593d1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.111314 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62e8b3c889a4a7d9ad49802644593d1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.113227 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:32.136602 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:32.269139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62e8b3c889a4a7d9ad49802644593d1', 'request_id': 'req-a97c3232-2a56-4e26-b3f5-4e783b201729'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:32.275350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62e8b3c889a4a7d9ad49802644593d1', 'request_id': 'req-a97c3232-2a56-4e26-b3f5-4e783b201729'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:32.344347 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62e8b3c889a4a7d9ad49802644593d1', 'request_id': 'req-a97c3232-2a56-4e26-b3f5-4e783b201729'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:32.356983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] The token cache is being invalidate because project d62e8b3c889a4a7d9ad49802644593d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:22:32.357271 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:32.357926 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a97c3232-2a56-4e26-b3f5-4e783b201729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:22:32.359825 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1357/2750] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:22:32 2022] DELETE /identity/v3/projects/d62e8b3c889a4a7d9ad49802644593d1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:22:32.365027 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294f41-0254-4c57-8d93-81e9a7d7938d None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.365395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294f41-0254-4c57-8d93-81e9a7d7938d None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.365881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294f41-0254-4c57-8d93-81e9a7d7938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.385713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-84294f41-0254-4c57-8d93-81e9a7d7938d None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:22:32.387001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-84294f41-0254-4c57-8d93-81e9a7d7938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:32.453395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1394/2751] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:22:32.461711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.462008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.462287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.480643 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:22:32.482475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:32.490476 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1358/2752] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:22:32.495385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.495674 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.495950 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.497948 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.507380 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd5412-635e-42fe-a7ab-8a8c6c2c2d05 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.512629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.513325 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.513612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.513889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.514434 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] MFA Rules not processed for user `7fec67e95dbe4394a1ae15469f2a282f`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:22:32.514614 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:22:32.514921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.515668 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:32.516727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:32.529428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1359/2753] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:22:32.533727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.546890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5325d-3543-44ad-8a49-eb15905cdeef admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.551687 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.555355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.555355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.555355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.555355 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.555774 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:32.573111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1395/2754] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:22:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:22:32.636719 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1360/2755] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:22:32 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:22:32.641476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.654604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55401b3-58bc-4ecc-a36e-764c9edffc42 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.683894 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:32.711946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.712623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.712905 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.713177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.713864 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.716346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:32.781008 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1396/2756] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:22:32 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:22:32.782235 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.792761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813a35-5a5f-49a0-a683-81824bff3201 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.797495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.798163 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.798457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.798740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.799507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.801146 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:32.816474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1361/2757] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:22:32.831214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.842281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8245-3314-4076-9341-dbaf9f817bc6 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.846960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac562-7c1e-4d53-91e5-a118464b57ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.847666 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac562-7c1e-4d53-91e5-a118464b57ff admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.847952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac562-7c1e-4d53-91e5-a118464b57ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.848229 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac562-7c1e-4d53-91e5-a118464b57ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.848971 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ac562-7c1e-4d53-91e5-a118464b57ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.850576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ac562-7c1e-4d53-91e5-a118464b57ff admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:32.860811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1397/2758] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:22:32.864966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:32.875937 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f43eb-3171-43aa-b312-1de4cb10fd91 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:32.880850 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:32.881749 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:32.882035 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:32.884212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] PATH_INFO: `/v3/projects/9808f004162146c089568a0261f09d59/users/97d63985256745499be671657584f271/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:32.898600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9808f004162146c089568a0261f09d59, user_id=97d63985256745499be671657584f271, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:32.902566 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:33.001710 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1362/2759] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:22:32 2022] PUT /identity/v3/projects/9808f004162146c089568a0261f09d59/users/97d63985256745499be671657584f271/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:22:33.007280 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc285d-dd82-4df4-8aa0-3de1ddd49712 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:33.007827 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc285d-dd82-4df4-8aa0-3de1ddd49712 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:33.008104 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc285d-dd82-4df4-8aa0-3de1ddd49712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:33.027529 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d7cc285d-dd82-4df4-8aa0-3de1ddd49712 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:22:33.033557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d7cc285d-dd82-4df4-8aa0-3de1ddd49712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:33.089322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1398/2760] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:22:33.099164 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:33.103847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:33.159714 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf1abd-249f-4ef2-a713-bbe67793794e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:33.163596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:33.164267 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:33.164665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:33.164955 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:33.174756 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:33.176286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:33.186590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1363/2761] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:39.318783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.319376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.319376 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.347967 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] MFA Rules not processed for user `97d63985256745499be671657584f271`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:22:39.349604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:39.434597 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1399/2762] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:22:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:22:39.439107 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:39.449129 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f8d7-c9c6-41f8-bf58-fabbfb379d5b service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:39.454496 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:39.455057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.455381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.455666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.456381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:39.458296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:39.576638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1364/2763] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:22:39 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:22:39.580951 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:39.588934 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb52f8-cff6-45b4-ade2-b98f6ef0285e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:39.628768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:39.648260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:39.648945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.649232 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.649509 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.650210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:39.652691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:39.754658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1400/2764] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:22:39 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:22:39.759026 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:39.769317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a049b4-91b8-4bb8-bcaa-fbeb02b10b00 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:39.773963 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:39.774618 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.774899 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.775172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.775980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:39.778081 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:39.783189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:39.788694 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1365/2765] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:22:39.792670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:39.803630 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b313d-a0ee-4417-a5b6-d329fc780fa7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:39.808411 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:39.809316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.809595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.809868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] PATH_INFO: `/v3/projects/85a37c843ef44706b107c0a0ce5106fc/users/23c0f701d91c4dd7983b98a33d9233f7/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.824832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a37c843ef44706b107c0a0ce5106fc, user_id=23c0f701d91c4dd7983b98a33d9233f7, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:39.827546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:39.874670 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1401/2766] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:22:39 2022] PUT /identity/v3/projects/85a37c843ef44706b107c0a0ce5106fc/users/23c0f701d91c4dd7983b98a33d9233f7/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:22:39.878846 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:39.889880 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6425ae-5785-4305-a10f-6ecb083ea792 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:39.959457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:39.960439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.960728 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.961009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.961745 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:39.963392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:39.974392 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1366/2767] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:22:39.978318 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:39.989343 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7743d0-10d7-4a83-82c9-d87bd20881cb admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:39.994047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b13935-acc6-4084-adbf-0c72164b6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:39.994997 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b13935-acc6-4084-adbf-0c72164b6441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:39.995385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b13935-acc6-4084-adbf-0c72164b6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:39.995745 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b13935-acc6-4084-adbf-0c72164b6441 admin admin] PATH_INFO: `/v3/projects/85a37c843ef44706b107c0a0ce5106fc/users/23c0f701d91c4dd7983b98a33d9233f7/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:39.997833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b13935-acc6-4084-adbf-0c72164b6441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a37c843ef44706b107c0a0ce5106fc, user_id=23c0f701d91c4dd7983b98a33d9233f7, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:40.000510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b13935-acc6-4084-adbf-0c72164b6441 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:40.011392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1402/2768] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:22:39 2022] PUT /identity/v3/projects/85a37c843ef44706b107c0a0ce5106fc/users/23c0f701d91c4dd7983b98a33d9233f7/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:22:43.674017 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:43.676604 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:43.865531 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d02d6-50d4-44dd-a27d-f2558f4479c8 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:44.005464 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:44.007051 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:44.007639 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:44.007922 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:44.010144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:44.026742 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:44.028528 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:44.046537 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1367/2769] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:46.141961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:46.142422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:46.142690 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:46.173505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] MFA Rules not processed for user `23c0f701d91c4dd7983b98a33d9233f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:22:46.174816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:46.256080 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1403/2770] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:22:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:22:46.271130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:46.272499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:46.288122 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06179f99-b953-404c-8ac2-b1b105dab619 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:46.295372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ec3a9-4eb3-4e73-ac0e-44d5f0ff50dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:46.296539 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ec3a9-4eb3-4e73-ac0e-44d5f0ff50dd service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:46.301021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ec3a9-4eb3-4e73-ac0e-44d5f0ff50dd service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:46.301021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ec3a9-4eb3-4e73-ac0e-44d5f0ff50dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:46.316914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:46.359020 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ec3a9-4eb3-4e73-ac0e-44d5f0ff50dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:46.360712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ec3a9-4eb3-4e73-ac0e-44d5f0ff50dd service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:46.370147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1368/2771] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:48.263903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:22:48.283047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582dbe2-fddf-4765-b883-be6cf767e424 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:22:48.289589 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:22:48.291300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:22:48.291857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:22:48.292352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:22:48.295136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:22:48.311317 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:22:48.313067 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:22:48.329885 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1404/2772] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:22:56.504102 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=19 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:58.321797 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=66,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:05.838944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:05.839451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:05.839638 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:05.867136 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] MFA Rules not processed for user `97d63985256745499be671657584f271`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:05.868350 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:05.890910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1369/2773] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:06.198304 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:06.273488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8a2ea-0196-48bc-8643-6fa9abe64d3e service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:06.277065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:06.282245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:06.282245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:06.282245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:06.282245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:06.302111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:06.303582 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:06.311580 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1405/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:23:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:23:07.012060 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:07.013932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:07.093313 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294797-0937-48bc-85ad-4b0b5000301c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:07.098474 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:07.099124 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:07.099574 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:07.105649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:07.105649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:07.113130 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:07.114690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:07.124881 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1370/2775] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:23:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:23:16.307930 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=40 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:17.120554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=50 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:23.582850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:23.601548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c747a2e-04e1-4ae9-adf8-d1f66ee61229 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:23.605207 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:23.605850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:23.606134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:23.606409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:23.615432 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:23.616868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:23.626386 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1406/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:23:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:23:33.622061 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=10 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:50.639829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:50.641767 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:50.736887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60cf7-6436-4feb-a4cb-4903789c789c service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:50.741357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:50.742218 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:50.742499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:50.742771 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] PATH_INFO: `/v3/users/7fec67e95dbe4394a1ae15469f2a282f` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:50.743964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fec67e95dbe4394a1ae15469f2a282f)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:50.745861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:50.886583 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fec67e95dbe4394a1ae15469f2a282f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:50.893962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fec67e95dbe4394a1ae15469f2a282f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:50.894624 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fec67e95dbe4394a1ae15469f2a282f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:50.895247 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fec67e95dbe4394a1ae15469f2a282f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:50.907274 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e151545a-8c41-4013-a0e1-fe80ddf5d3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fec67e95dbe4394a1ae15469f2a282f'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:50.964030 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1371/2777] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:23:50 2022] DELETE /identity/v3/users/7fec67e95dbe4394a1ae15469f2a282f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:51.194893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:51.205641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45058d-77b6-488b-bc6f-3b92df01b8a9 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:51.263299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:51.264160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.264439 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.264710 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] PATH_INFO: `/v3/projects/8a9d7d82538e45f7a021dd27b6203f9a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.265886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9d7d82538e45f7a021dd27b6203f9a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:51.267809 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:51.370096 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9d7d82538e45f7a021dd27b6203f9a', 'request_id': 'req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:51.376854 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9d7d82538e45f7a021dd27b6203f9a', 'request_id': 'req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:51.466970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9d7d82538e45f7a021dd27b6203f9a', 'request_id': 'req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:51.477661 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] The token cache is being invalidate because project 8a9d7d82538e45f7a021dd27b6203f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:23:51.477953 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:51.478590 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-5c595ba2-959a-4e7d-a3cb-ff3ae407ab27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:51.480177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1407/2778] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:23:51 2022] DELETE /identity/v3/projects/8a9d7d82538e45f7a021dd27b6203f9a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:23:51.485943 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.486241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.486553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.542698 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:51.543929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:51.557219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:51.602650 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1372/2779] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:51.611691 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.611979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.612256 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.630786 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:51.636245 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:51.640290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1408/2780] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:51.644553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:51.654192 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3767a-367e-4531-b17e-5d7c52f054cd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:51.659202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:51.659887 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.660174 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.660453 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.661169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:23:51.661475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:51.663071 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:51.675305 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1373/2781] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:23:51.679395 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:51.688576 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81135124-e8db-4ca0-8845-a3158282e821 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:51.693393 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:51.694072 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.694357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.694631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.695366 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:51.697279 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:51.776736 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1409/2782] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:23:51 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:23:51.780947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:51.791251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c08d5-575a-47f3-810f-0318fa1d1f38 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:51.845892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:51.846554 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.846841 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.847120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.847845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:51.849777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:51.942382 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1374/2783] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:23:51 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:23:51.946533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:51.957820 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3c93-5f55-4e2b-881d-8d39f706ed07 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:51.962445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:51.963106 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.963446 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.963728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.964449 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:51.966053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:51.977360 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1410/2784] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:51.981345 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:51.991506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedda83-6f34-4418-82ea-36b615b88d91 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:51.996326 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c13e9f-065c-46b2-90c4-17c885baf91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:51.996995 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c13e9f-065c-46b2-90c4-17c885baf91b admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:51.997284 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c13e9f-065c-46b2-90c4-17c885baf91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:51.997565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c13e9f-065c-46b2-90c4-17c885baf91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:51.998295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c13e9f-065c-46b2-90c4-17c885baf91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:52.000503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c13e9f-065c-46b2-90c4-17c885baf91b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:52.011513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1375/2785] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:52.016363 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:52.026273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff970-fa00-4929-8110-6ef3d466a44c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:52.030900 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:52.032400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:52.032681 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:52.032956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] PATH_INFO: `/v3/projects/8b5b4d795dc048cf96b96cb07dc7d48d/users/bb529d3f0ce64c1cafcd42cbcd1151a1/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:52.047358 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5b4d795dc048cf96b96cb07dc7d48d, user_id=bb529d3f0ce64c1cafcd42cbcd1151a1, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:52.049987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:52.107941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1411/2786] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:23:52 2022] PUT /identity/v3/projects/8b5b4d795dc048cf96b96cb07dc7d48d/users/bb529d3f0ce64c1cafcd42cbcd1151a1/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:23:52.113551 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a4c3-c8ca-47d1-9673-9f403e614567 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:52.115176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a4c3-c8ca-47d1-9673-9f403e614567 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:52.115176 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a4c3-c8ca-47d1-9673-9f403e614567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:52.133103 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-29a1a4c3-c8ca-47d1-9673-9f403e614567 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:52.134307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-29a1a4c3-c8ca-47d1-9673-9f403e614567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:52.192776 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1376/2787] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:52.202400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:52.204645 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:52.235059 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:52.260700 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a390-4e2f-48d8-a3ae-ffb79075bc1a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:52.264405 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:52.265076 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:52.265421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:52.266383 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:52.276016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:52.277453 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:52.287698 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1412/2788] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:23:53.507904 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526058e4-5918-4743-902b-00a797b89101 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:53.511601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526058e4-5918-4743-902b-00a797b89101 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:53.511601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526058e4-5918-4743-902b-00a797b89101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:53.536172 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-526058e4-5918-4743-902b-00a797b89101 None None] MFA Rules not processed for user `bb529d3f0ce64c1cafcd42cbcd1151a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:53.537492 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-526058e4-5918-4743-902b-00a797b89101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:53.550249 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:53.602475 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1377/2789] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:53.606939 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:53.616521 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03d66-6f84-4968-89ac-ff3faacaa6f0 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:53.621078 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:53.621724 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:53.622009 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:53.622451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:53.623147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:53.625720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:53.720379 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1413/2790] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:23:53 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:23:53.724403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526058e4-5918-4743-902b-00a797b89101 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:53.735709 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526058e4-5918-4743-902b-00a797b89101 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:53.793329 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:53.793929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:53.794219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:53.794499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] PATH_INFO: `/v3/users` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:53.795222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:53.797287 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:53.884173 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1378/2791] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:23:53 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:23:53.888160 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:53.899136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eed19-0764-48f0-b57c-99d887bf7f77 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:53.903937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:53.904609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:53.904896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:53.905175 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:53.905920 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:53.907596 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:53.918381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1414/2792] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:53.922911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:53.933219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5a899-f27f-427f-8340-f19ee7248006 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:53.938436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:53.939363 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:53.939654 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:53.939935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] PATH_INFO: `/v3/projects/1cc460123b7e462ba6e21154b649aef1/users/163458129576493d82ee73e805f14f0a/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:53.955462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc460123b7e462ba6e21154b649aef1, user_id=163458129576493d82ee73e805f14f0a, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:53.958106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:54.021834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1379/2793] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:23:53 2022] PUT /identity/v3/projects/1cc460123b7e462ba6e21154b649aef1/users/163458129576493d82ee73e805f14f0a/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:54.025833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:54.035783 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81380-022c-480e-8284-7c5d33d9b152 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:54.091574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5b775-ba60-4b9f-9724-bd0267bdb0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:54.092491 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5b775-ba60-4b9f-9724-bd0267bdb0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:54.092781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5b775-ba60-4b9f-9724-bd0267bdb0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:54.093056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5b775-ba60-4b9f-9724-bd0267bdb0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:54.093776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5b775-ba60-4b9f-9724-bd0267bdb0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:54.095389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5b775-ba60-4b9f-9724-bd0267bdb0e0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:54.104999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1415/2794] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:54.109083 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:54.119033 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf624eb-f039-49e1-8ee0-225dfd63a5b0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:54.123596 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:54.124497 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:54.124779 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:54.125590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] PATH_INFO: `/v3/projects/1cc460123b7e462ba6e21154b649aef1/users/163458129576493d82ee73e805f14f0a/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:54.127558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc460123b7e462ba6e21154b649aef1, user_id=163458129576493d82ee73e805f14f0a, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:54.130141 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:54.140493 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1380/2795] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:23:54 2022] PUT /identity/v3/projects/1cc460123b7e462ba6e21154b649aef1/users/163458129576493d82ee73e805f14f0a/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:55.401578 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:55.402137 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:55.402281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:55.430768 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] MFA Rules not processed for user `163458129576493d82ee73e805f14f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:55.432249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:55.503219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1416/2796] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:56.716660 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:56.719607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:56.786565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:56.808984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d88ae-f4d9-4975-8ebe-b3cfc083d389 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:56.814600 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:56.815273 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:56.815565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:56.815843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:56.817594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:56.829579 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:56.831246 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:56.839780 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:56.845985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1381/2797] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:23:56.861071 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:56.910154 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c9d3-1c32-4e29-b0c4-385beae7c58f None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:56.914692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:56.915595 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:56.915877 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:56.916150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] PATH_INFO: `/v3/users/bb529d3f0ce64c1cafcd42cbcd1151a1` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:56.917417 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb529d3f0ce64c1cafcd42cbcd1151a1)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:56.919823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:57.137850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb529d3f0ce64c1cafcd42cbcd1151a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.145293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb529d3f0ce64c1cafcd42cbcd1151a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.145946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb529d3f0ce64c1cafcd42cbcd1151a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.146540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb529d3f0ce64c1cafcd42cbcd1151a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.158205 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb529d3f0ce64c1cafcd42cbcd1151a1'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.238821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1417/2798] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:23:56 2022] DELETE /identity/v3/users/bb529d3f0ce64c1cafcd42cbcd1151a1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:57.548720 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:57.560545 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee492603-4d32-463a-a561-56f43f9ba35e service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:57.617088 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:57.617956 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:57.618242 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:57.618519 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] PATH_INFO: `/v3/projects/8b5b4d795dc048cf96b96cb07dc7d48d` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:57.619732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5b4d795dc048cf96b96cb07dc7d48d)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:57.621635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:57.747532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5b4d795dc048cf96b96cb07dc7d48d', 'request_id': 'req-b88a4515-4736-45a0-b890-c0050d45aca6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.753737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5b4d795dc048cf96b96cb07dc7d48d', 'request_id': 'req-b88a4515-4736-45a0-b890-c0050d45aca6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.821259 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5b4d795dc048cf96b96cb07dc7d48d', 'request_id': 'req-b88a4515-4736-45a0-b890-c0050d45aca6'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.831561 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] The token cache is being invalidate because project 8b5b4d795dc048cf96b96cb07dc7d48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:23:57.833239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.833239 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:57.834397 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1382/2799] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:23:57 2022] DELETE /identity/v3/projects/8b5b4d795dc048cf96b96cb07dc7d48d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:57.838239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:57.839740 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:57.853234 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f7a1d-2e66-457c-a732-93cce3ce5a36 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:57.910179 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:57.911053 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:57.911372 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:57.911654 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] PATH_INFO: `/v3/users/163458129576493d82ee73e805f14f0a` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:57.912904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=163458129576493d82ee73e805f14f0a)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:57.914833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:58.091826 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:58.098162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163458129576493d82ee73e805f14f0a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.104861 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163458129576493d82ee73e805f14f0a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.105549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163458129576493d82ee73e805f14f0a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.106170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163458129576493d82ee73e805f14f0a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.117770 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-7dc5e2ff-218b-41d4-9a3f-b6e239c0c26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163458129576493d82ee73e805f14f0a'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.185896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1418/2800] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:23:57 2022] DELETE /identity/v3/users/163458129576493d82ee73e805f14f0a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:58.436024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:58.436024 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:58.448478 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a4515-4736-45a0-b890-c0050d45aca6 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:58.507344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:58.508219 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:58.508510 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:58.508790 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] PATH_INFO: `/v3/projects/1cc460123b7e462ba6e21154b649aef1` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:58.509989 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc460123b7e462ba6e21154b649aef1)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:58.511953 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:58.522999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:58.650210 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc460123b7e462ba6e21154b649aef1', 'request_id': 'req-33420466-39a5-4858-be29-11cabca31c63'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.656533 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc460123b7e462ba6e21154b649aef1', 'request_id': 'req-33420466-39a5-4858-be29-11cabca31c63'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.729703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc460123b7e462ba6e21154b649aef1', 'request_id': 'req-33420466-39a5-4858-be29-11cabca31c63'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.740944 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] The token cache is being invalidate because project 1cc460123b7e462ba6e21154b649aef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:23:58.741251 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.741864 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-33420466-39a5-4858-be29-11cabca31c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:23:58.743444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1383/2801] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:23:58 2022] DELETE /identity/v3/projects/1cc460123b7e462ba6e21154b649aef1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:23:58.748419 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:58.756653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:58.756653 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:58.767469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:58.768728 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:58.827406 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1419/2802] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:58.836283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:58.836761 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:58.836898 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:58.855834 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:58.857062 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:58.865337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1384/2803] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:58.869337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:58.879400 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b7b15-31ec-4cef-8fcd-dbc89124d6b2 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:58.884316 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:58.884986 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:58.885257 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:58.885534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:58.886262 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:23:58.886572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:58.888210 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:58.899763 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1420/2804] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:23:58.903862 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:58.912849 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267a6f-fa25-4697-bdda-59e8b4b9dc03 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:58.917390 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:58.918029 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:58.918311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:58.918582 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:58.919300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:58.921236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:58.999641 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1385/2805] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:23:58 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:23:59.004324 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.014399 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa03962-0649-4813-a277-cb8fb21eee6c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.069219 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.069882 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.070162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.070435 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.071120 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.073045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.169713 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1421/2806] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:23:59 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:23:59.174513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.184695 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d487a90-1ecc-4606-b2c5-36bca7e7bdaf admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.189421 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.190142 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.190422 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.190696 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.191507 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.193162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.203886 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1386/2807] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:59.207734 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.217658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4dcb5-293c-4dfc-8455-124168b77d3b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.223186 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc72e1-6ea6-4ab7-9ddd-5d5e0afef041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.223873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc72e1-6ea6-4ab7-9ddd-5d5e0afef041 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.224161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc72e1-6ea6-4ab7-9ddd-5d5e0afef041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.224441 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc72e1-6ea6-4ab7-9ddd-5d5e0afef041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.225169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc72e1-6ea6-4ab7-9ddd-5d5e0afef041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.226767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc72e1-6ea6-4ab7-9ddd-5d5e0afef041 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.237300 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1422/2808] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:59.241286 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.251140 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6127-318b-417a-b7f0-8add37dc3812 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.255663 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.256529 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.256815 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.257346 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] PATH_INFO: `/v3/projects/e1d92dc8a7ab4e8d91c6c07bfa454dbe/users/1537a8a1bffe435891880c2b03360be0/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.271717 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d92dc8a7ab4e8d91c6c07bfa454dbe, user_id=1537a8a1bffe435891880c2b03360be0, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.274344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.340914 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1387/2809] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:23:59 2022] PUT /identity/v3/projects/e1d92dc8a7ab4e8d91c6c07bfa454dbe/users/1537a8a1bffe435891880c2b03360be0/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:59.351741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.352043 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.352357 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.378886 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] MFA Rules not processed for user `1537a8a1bffe435891880c2b03360be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:23:59.380133 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:23:59.391492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:59.444514 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1423/2810] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:23:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:23:59.449177 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.512894 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3a713-125e-458c-b946-320c545f4ada admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.517924 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.518575 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.518858 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.519132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.519861 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.521751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.593386 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1388/2811] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:23:59 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:23:59.598085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.608646 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4125-5c22-4d2e-a0c4-64726af6bccc None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.664143 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.664824 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.665113 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.665396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.666081 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.668025 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.745874 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1424/2812] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:23:59 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:23:59.749829 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.760255 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60564c-f557-49d3-b8ac-149276d14d96 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.764970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.766119 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.766407 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.766686 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.767434 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.769046 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.779440 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1389/2813] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:23:59.784084 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.794242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7f87-491c-462c-af69-16523c5ca2b9 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.799069 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.799985 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.800273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.800551 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] PATH_INFO: `/v3/projects/6eafd77938a9442f8ab49b54536cf21e/users/398ffea9cc83400d992cc6fd510b1b8e/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.815689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eafd77938a9442f8ab49b54536cf21e, user_id=398ffea9cc83400d992cc6fd510b1b8e, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.818326 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.912241 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1425/2814] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:23:59 2022] PUT /identity/v3/projects/6eafd77938a9442f8ab49b54536cf21e/users/398ffea9cc83400d992cc6fd510b1b8e/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:23:59.916097 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:23:59.926279 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf315a2a-0fb7-4c35-b847-7b7f6de08e62 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:23:59.931027 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:59.982765 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae9ca-fbb8-445d-944b-a3141f67e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:23:59.983449 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae9ca-fbb8-445d-944b-a3141f67e3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:23:59.983738 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae9ca-fbb8-445d-944b-a3141f67e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:23:59.984010 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae9ca-fbb8-445d-944b-a3141f67e3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:23:59.984718 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dae9ca-fbb8-445d-944b-a3141f67e3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:23:59.986378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dae9ca-fbb8-445d-944b-a3141f67e3dc admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:23:59.995781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1390/2815] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:00.000389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:00.010941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0656ac-9408-4368-a061-f9e8a7c2f7cc admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:00.016373 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:00.017166 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:00.017448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:00.017722 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] PATH_INFO: `/v3/projects/6eafd77938a9442f8ab49b54536cf21e/users/398ffea9cc83400d992cc6fd510b1b8e/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:00.019878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eafd77938a9442f8ab49b54536cf21e, user_id=398ffea9cc83400d992cc6fd510b1b8e, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:00.022517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:00.032581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1426/2816] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:23:59 2022] PUT /identity/v3/projects/6eafd77938a9442f8ab49b54536cf21e/users/398ffea9cc83400d992cc6fd510b1b8e/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:00.043451 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:00.043768 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:00.044049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:00.071057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] MFA Rules not processed for user `398ffea9cc83400d992cc6fd510b1b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:00.072321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:00.139148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1391/2817] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:00.150960 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:00.152715 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:00.226377 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:00.234046 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78906dbf-8d47-4407-a847-acee13ac00e1 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:00.238293 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:00.245247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:00.245247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:00.245247 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:00.248469 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:00.250540 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:00.260177 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1427/2818] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:00.474970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:00.484874 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419852a6-d3ce-4f6a-a9fc-10d96f395666 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:00.488403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30707e-eed2-4b72-b805-074bbc34890c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:00.489047 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30707e-eed2-4b72-b805-074bbc34890c service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:00.489334 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30707e-eed2-4b72-b805-074bbc34890c service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:00.489622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30707e-eed2-4b72-b805-074bbc34890c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:00.547666 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30707e-eed2-4b72-b805-074bbc34890c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:00.549132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30707e-eed2-4b72-b805-074bbc34890c service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:00.558232 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1392/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:10.289866 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:10.554068 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=87 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:12.069346 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:12.132188 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8dbe-1e3b-4a4b-86e9-6d7824556462 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:12.136629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:12.137486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:12.137767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:12.138038 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] PATH_INFO: `/v3/users/1537a8a1bffe435891880c2b03360be0` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:12.139196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1537a8a1bffe435891880c2b03360be0)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:12.141651 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:12.354993 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1537a8a1bffe435891880c2b03360be0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:12.362152 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1537a8a1bffe435891880c2b03360be0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:12.362822 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1537a8a1bffe435891880c2b03360be0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:12.363459 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1537a8a1bffe435891880c2b03360be0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:12.375023 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1537a8a1bffe435891880c2b03360be0'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:12.461465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1428/2820] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:24:12 2022] DELETE /identity/v3/users/1537a8a1bffe435891880c2b03360be0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:12.466338 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:12.466818 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:12.466935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:12.484777 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:12.486412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:12.546132 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1393/2821] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:12.555739 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:12.557239 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:12.615156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9713286-58ee-449c-9cf4-8607d38b252b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:12.618702 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:12.619390 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:12.619672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:12.619946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:12.629331 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:12.630748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:12.640474 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1429/2822] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:13.045205 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:13.046609 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:13.060619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767f53-a4a4-4913-b13c-1dfef35f2c79 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:13.065965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:13.071499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:13.071499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:13.071499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] PATH_INFO: `/v3/projects/e1d92dc8a7ab4e8d91c6c07bfa454dbe` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:13.071499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d92dc8a7ab4e8d91c6c07bfa454dbe)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:13.071499 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:13.187553 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d92dc8a7ab4e8d91c6c07bfa454dbe', 'request_id': 'req-c04c1ca4-a0ab-41fc-8943-f262ffb53815'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.194391 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d92dc8a7ab4e8d91c6c07bfa454dbe', 'request_id': 'req-c04c1ca4-a0ab-41fc-8943-f262ffb53815'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.254868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d92dc8a7ab4e8d91c6c07bfa454dbe', 'request_id': 'req-c04c1ca4-a0ab-41fc-8943-f262ffb53815'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.265726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] The token cache is being invalidate because project e1d92dc8a7ab4e8d91c6c07bfa454dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:24:13.266328 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.266647 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.268217 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1394/2823] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:24:13 2022] DELETE /identity/v3/projects/e1d92dc8a7ab4e8d91c6c07bfa454dbe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:13.272333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:13.282507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3d69-4edc-4c63-9eeb-f6c0469b6625 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:13.300725 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:13.336833 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:13.337705 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:13.337987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:13.338261 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] PATH_INFO: `/v3/users/398ffea9cc83400d992cc6fd510b1b8e` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:13.339465 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=398ffea9cc83400d992cc6fd510b1b8e)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:13.341368 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:13.571016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398ffea9cc83400d992cc6fd510b1b8e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.577692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398ffea9cc83400d992cc6fd510b1b8e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.578352 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398ffea9cc83400d992cc6fd510b1b8e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.578961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398ffea9cc83400d992cc6fd510b1b8e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.590735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-f1b66727-47f9-4da8-a393-2d7d560fc79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398ffea9cc83400d992cc6fd510b1b8e'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:13.679802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1430/2824] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:24:13 2022] DELETE /identity/v3/users/398ffea9cc83400d992cc6fd510b1b8e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:24:14.056681 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.058170 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:14.072013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c1ca4-a0ab-41fc-8943-f262ffb53815 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.129439 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.132236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.132236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.132236 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] PATH_INFO: `/v3/projects/6eafd77938a9442f8ab49b54536cf21e` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.132569 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eafd77938a9442f8ab49b54536cf21e)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.134159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.215772 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:14.231890 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eafd77938a9442f8ab49b54536cf21e', 'request_id': 'req-8bcef794-7425-4c81-b9b7-a7a45f859a37'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:14.240072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eafd77938a9442f8ab49b54536cf21e', 'request_id': 'req-8bcef794-7425-4c81-b9b7-a7a45f859a37'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:14.300523 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eafd77938a9442f8ab49b54536cf21e', 'request_id': 'req-8bcef794-7425-4c81-b9b7-a7a45f859a37'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:14.311111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] The token cache is being invalidate because project 6eafd77938a9442f8ab49b54536cf21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:24:14.311427 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:14.312057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bcef794-7425-4c81-b9b7-a7a45f859a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:14.313636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1395/2825] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:24:14 2022] DELETE /identity/v3/projects/6eafd77938a9442f8ab49b54536cf21e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:14.319306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.319803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.319914 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.338444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:14.339748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:14.398741 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1431/2826] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:14.406668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.406984 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.407295 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.425947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:14.427150 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:14.435070 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1396/2827] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:14.440018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.449906 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cdccd-9d80-436e-a4d3-a3e28db61c5e None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.454687 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.455382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.455669 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.455949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.456677 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:24:14.456988 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.458591 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.470086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1432/2828] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:24:14.474311 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.483587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbb6ac-70e1-4bcc-9c95-c3bfc0f09d6f None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.488740 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.489385 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.489670 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.489946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.490651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.492590 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.576578 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1397/2829] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:24:14 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:14.580641 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.590493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de068b7f-a1ac-43dc-811a-a8a68e3799b7 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.616314 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:14.646478 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.647147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.647462 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.647793 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.648492 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.650450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.758306 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1433/2830] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:24:14 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:14.762468 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.773120 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb7740-e11c-4e54-804a-d7364b948623 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.777889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.778649 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.778940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.779222 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.779985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.781587 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.792359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1398/2831] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:14.796136 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.806433 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb04f-76d6-45ce-a655-ea5db6d44abe admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.810964 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638692c3-17f4-4cc1-aa09-f693b611a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.811662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638692c3-17f4-4cc1-aa09-f693b611a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.811949 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638692c3-17f4-4cc1-aa09-f693b611a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.812227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638692c3-17f4-4cc1-aa09-f693b611a1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.812945 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638692c3-17f4-4cc1-aa09-f693b611a1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.814555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638692c3-17f4-4cc1-aa09-f693b611a1e5 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.824240 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1434/2832] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:14.828089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:14.837667 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1591cc4-f60b-4a0a-90cf-d8a8c1b253f9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:14.842208 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:14.843066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.843463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.843743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] PATH_INFO: `/v3/projects/212093addec04e0288d15b3babf90c73/users/e34c7035a00f40edbe3b9fed141c876c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.858049 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=212093addec04e0288d15b3babf90c73, user_id=e34c7035a00f40edbe3b9fed141c876c, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:14.860703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:14.959032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1399/2833] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:24:14 2022] PUT /identity/v3/projects/212093addec04e0288d15b3babf90c73/users/e34c7035a00f40edbe3b9fed141c876c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:14.969555 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:14.969848 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:14.970156 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:14.997467 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] MFA Rules not processed for user `e34c7035a00f40edbe3b9fed141c876c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:14.998672 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:15.065843 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1435/2834] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:15.070394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.132627 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bb475-a438-47a0-861d-cec5a204e6fa admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.137296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.137954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.138238 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.138520 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.139337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.141168 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.257303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1400/2835] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:24:15 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:15.261134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.272710 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759c499-59a4-4ba8-a106-c0b95f8f7454 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.333063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155009-ae67-478c-981f-09401d483163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.333767 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155009-ae67-478c-981f-09401d483163 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.334022 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155009-ae67-478c-981f-09401d483163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.334298 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04155009-ae67-478c-981f-09401d483163 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.335006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155009-ae67-478c-981f-09401d483163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.337002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04155009-ae67-478c-981f-09401d483163 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.416409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1436/2836] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:24:15 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:15.420402 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.430787 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7202c-9e91-4481-a8b3-a7b7aca18955 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.435495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.436165 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.436450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.436807 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.437592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.439224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.456794 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1401/2837] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:15.461049 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155009-ae67-478c-981f-09401d483163 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.472263 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04155009-ae67-478c-981f-09401d483163 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.476972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.477869 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.478209 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.478493 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] PATH_INFO: `/v3/projects/ca9c541bf72342278d14a62cce0c4813/users/1c988fce2b6d41e69a7ee8b81032e8b5/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.493711 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9c541bf72342278d14a62cce0c4813, user_id=1c988fce2b6d41e69a7ee8b81032e8b5, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.496455 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.564065 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1437/2838] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:24:15 2022] PUT /identity/v3/projects/ca9c541bf72342278d14a62cce0c4813/users/1c988fce2b6d41e69a7ee8b81032e8b5/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:15.568567 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.581494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5e68-2ebc-4c1d-8ee4-8facd0e9feb7 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.605665 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:15.646941 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7148d90-382c-4afa-9853-b9d45c4373ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.647712 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7148d90-382c-4afa-9853-b9d45c4373ca admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.647999 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7148d90-382c-4afa-9853-b9d45c4373ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.648277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7148d90-382c-4afa-9853-b9d45c4373ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.649009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7148d90-382c-4afa-9853-b9d45c4373ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.650662 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7148d90-382c-4afa-9853-b9d45c4373ca admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.663992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1402/2839] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:15.665124 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.670623 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:15.677421 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2bf2b-2983-4225-8ca0-a69329c2b93f admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.682122 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.683019 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.683456 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.683743 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] PATH_INFO: `/v3/projects/ca9c541bf72342278d14a62cce0c4813/users/1c988fce2b6d41e69a7ee8b81032e8b5/roles/1824060ea6e647969fbd916218fe88ea` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.685714 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9c541bf72342278d14a62cce0c4813, user_id=1c988fce2b6d41e69a7ee8b81032e8b5, role_id=1824060ea6e647969fbd916218fe88ea)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.688391 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.699532 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1438/2840] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:24:15 2022] PUT /identity/v3/projects/ca9c541bf72342278d14a62cce0c4813/users/1c988fce2b6d41e69a7ee8b81032e8b5/roles/1824060ea6e647969fbd916218fe88ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:15.764622 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.764946 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.765307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.792558 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] MFA Rules not processed for user `1c988fce2b6d41e69a7ee8b81032e8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:15.793741 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:15.863500 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1403/2841] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:15.875002 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:15.878140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:15.937451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b66ee-0399-4b8d-a802-c0a05d0685f8 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:15.942294 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:15.942557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:15.942842 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:15.943117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:15.952225 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:15.953652 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:15.962932 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1439/2842] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:16.008585 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:16.009969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:16.021751 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57436a-d77c-4485-b4c4-112a473336e8 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:16.025394 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d05c2-5654-4230-a10e-ecf1a69a831e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:16.026034 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d05c2-5654-4230-a10e-ecf1a69a831e service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:16.026317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d05c2-5654-4230-a10e-ecf1a69a831e service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:16.026592 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d05c2-5654-4230-a10e-ecf1a69a831e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:16.083607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d05c2-5654-4230-a10e-ecf1a69a831e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:16.084978 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d05c2-5654-4230-a10e-ecf1a69a831e service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:16.093672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1404/2843] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:20.577777 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:20.639125 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee32e-6b35-4f6a-8465-533c45691b95 service cinder] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:20.643699 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:20.644552 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:20.644831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:20.645103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] PATH_INFO: `/v3/users/e34c7035a00f40edbe3b9fed141c876c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:20.646265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34c7035a00f40edbe3b9fed141c876c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:20.648237 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:20.827798 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34c7035a00f40edbe3b9fed141c876c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:20.834385 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34c7035a00f40edbe3b9fed141c876c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:20.835044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34c7035a00f40edbe3b9fed141c876c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:20.835686 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34c7035a00f40edbe3b9fed141c876c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:20.847887 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34c7035a00f40edbe3b9fed141c876c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:20.916836 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1440/2844] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:24:20 2022] DELETE /identity/v3/users/e34c7035a00f40edbe3b9fed141c876c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:20.921348 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:20.921845 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:20.921985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:20.939413 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:20.940617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:20.979913 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=100 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:20.998675 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1405/2845] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:21.008392 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:21.009788 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:21.023150 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:21.066963 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a4633-63ae-4acf-acbf-5540f525529d admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:21.070682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:21.071350 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:21.071634 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:21.071910 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:21.081537 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:21.082884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:21.092226 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1441/2846] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:21.467547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:21.468966 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:21.483186 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21ea49-b227-4cd7-a893-9cbf9edd1d4e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:21.488175 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:21.489053 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:21.489336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:21.489610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] PATH_INFO: `/v3/projects/212093addec04e0288d15b3babf90c73` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:21.490795 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=212093addec04e0288d15b3babf90c73)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:21.493503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:21.574300 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212093addec04e0288d15b3babf90c73', 'request_id': 'req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.581169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212093addec04e0288d15b3babf90c73', 'request_id': 'req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.632315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212093addec04e0288d15b3babf90c73', 'request_id': 'req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.643444 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] The token cache is being invalidate because project 212093addec04e0288d15b3babf90c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:24:21.643734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.644370 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.645935 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1406/2847] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:24:21 2022] DELETE /identity/v3/projects/212093addec04e0288d15b3babf90c73 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:21.649919 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:21.659398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4ab33-4408-469b-9828-b2d4a1c0ad88 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:21.713871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:21.714735 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:21.715018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:21.715333 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] PATH_INFO: `/v3/users/1c988fce2b6d41e69a7ee8b81032e8b5` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:21.716519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c988fce2b6d41e69a7ee8b81032e8b5)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:21.718428 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:21.890781 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c988fce2b6d41e69a7ee8b81032e8b5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.897620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c988fce2b6d41e69a7ee8b81032e8b5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.898287 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c988fce2b6d41e69a7ee8b81032e8b5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.898974 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c988fce2b6d41e69a7ee8b81032e8b5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.910604 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-830999d5-5f52-4b6d-acc6-d7c886af640f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c988fce2b6d41e69a7ee8b81032e8b5'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:21.980397 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1442/2848] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:24:21 2022] DELETE /identity/v3/users/1c988fce2b6d41e69a7ee8b81032e8b5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:22.359954 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:22.362162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:22.376925 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5641-2bf2-4fa5-8618-d42d186b3e1e admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:22.437630 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:22.438455 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:22.438737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:22.439016 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] PATH_INFO: `/v3/projects/ca9c541bf72342278d14a62cce0c4813` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:22.440268 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9c541bf72342278d14a62cce0c4813)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:22.442241 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:22.540831 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9c541bf72342278d14a62cce0c4813', 'request_id': 'req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:22.546910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9c541bf72342278d14a62cce0c4813', 'request_id': 'req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:22.609108 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9c541bf72342278d14a62cce0c4813', 'request_id': 'req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:22.615532 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:22.620050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] The token cache is being invalidate because project ca9c541bf72342278d14a62cce0c4813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:24:22.620337 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:22.620958 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-a1fb64e5-4d0d-4e58-8fb3-027c23b76f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:22.622704 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1407/2849] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:24:22 2022] DELETE /identity/v3/projects/ca9c541bf72342278d14a62cce0c4813 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:22.627721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:22.628016 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:22.628295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:22.646656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:22.647947 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:22.677613 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:22.706803 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1443/2850] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:22.714659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:22.715138 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:22.715517 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:22.734157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:22.735368 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:22.743199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1408/2851] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:24:22.747319 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:22.757024 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609766c-3394-4e68-a197-437b785d7d7c None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:22.761697 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:22.762389 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:22.762689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:22.762969 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:22.763721 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:24:22.764032 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:22.765629 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:22.777557 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1444/2852] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:24:22.781732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:22.791565 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7715-ed74-4c94-afdf-d4a0ded91c8c None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:22.796224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:22.798505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:22.798505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:22.798505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:22.798505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:22.800202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:22.878969 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1409/2853] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:24:22 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:22.889946 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:22.900574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026004f8-4fb3-439d-91aa-608783d99d75 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:22.958975 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:22.959586 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:22.959870 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:22.960142 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:22.960832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:22.962737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:23.054941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1445/2854] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:24:22 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:24:23.059204 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:23.070162 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442789e-7468-4c01-8878-e11d5dfad59d admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:23.074888 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:23.075594 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:23.075884 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:23.076159 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:23.076970 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:23.078599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:23.089593 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1410/2855] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:24:23.093422 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:23.103370 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38373b-4f67-4eab-81d9-d8a1608e0a30 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:23.107937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7820b-de41-4fd9-a0bd-2f4366af90ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:23.108594 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7820b-de41-4fd9-a0bd-2f4366af90ea admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:23.108881 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7820b-de41-4fd9-a0bd-2f4366af90ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:23.109159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7820b-de41-4fd9-a0bd-2f4366af90ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:23.109884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7820b-de41-4fd9-a0bd-2f4366af90ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:23.111572 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7820b-de41-4fd9-a0bd-2f4366af90ea admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:23.121273 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1446/2856] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:23.125206 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:23.135769 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb87a-ff75-4e8e-acc4-f0cd2a5cd3f2 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:23.140432 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:23.141303 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:23.141588 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:23.141889 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] PATH_INFO: `/v3/projects/6a2c335723e24762a388fd7a5cfb59cd/users/100539750cf74d48a9408b616b4e125c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:23.156607 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2c335723e24762a388fd7a5cfb59cd, user_id=100539750cf74d48a9408b616b4e125c, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:23.159335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:23.214763 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1411/2857] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:24:23 2022] PUT /identity/v3/projects/6a2c335723e24762a388fd7a5cfb59cd/users/100539750cf74d48a9408b616b4e125c/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:24:23.224871 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:23.225169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:23.225487 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:23.252047 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] MFA Rules not processed for user `100539750cf74d48a9408b616b4e125c`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:23.253334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:23.315750 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1447/2858] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:23.326617 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:23.328310 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:23.385457 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b2c3-ebda-4e06-8722-78ed6a4611a3 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:23.389195 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdcf0a-15ac-43d6-b98d-4c6a0cb273af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:23.389847 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdcf0a-15ac-43d6-b98d-4c6a0cb273af service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:23.390135 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdcf0a-15ac-43d6-b98d-4c6a0cb273af service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:23.390416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdcf0a-15ac-43d6-b98d-4c6a0cb273af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:23.398734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdcf0a-15ac-43d6-b98d-4c6a0cb273af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:23.400200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdcf0a-15ac-43d6-b98d-4c6a0cb273af service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:23.408985 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1412/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:26.372196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:26.403944 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:26.435656 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f6aa7-d71c-4d76-bc44-e6e0b8815060 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:26.440847 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:26.441737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:26.442030 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:26.442519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] PATH_INFO: `/v3/users/100539750cf74d48a9408b616b4e125c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:26.444157 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=100539750cf74d48a9408b616b4e125c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:26.446134 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:26.628495 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100539750cf74d48a9408b616b4e125c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:26.635638 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100539750cf74d48a9408b616b4e125c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:26.636349 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100539750cf74d48a9408b616b4e125c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:26.636979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100539750cf74d48a9408b616b4e125c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:26.648631 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100539750cf74d48a9408b616b4e125c'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:26.699794 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1448/2860] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:24:26 2022] DELETE /identity/v3/users/100539750cf74d48a9408b616b4e125c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:26.704378 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422980d-d383-425d-940f-08afb587979e None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:26.704843 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422980d-d383-425d-940f-08afb587979e None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:26.704962 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422980d-d383-425d-940f-08afb587979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:26.722200 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-5422980d-d383-425d-940f-08afb587979e None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:26.723420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5422980d-d383-425d-940f-08afb587979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:26.781028 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1413/2861] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 09:24:26.791017 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:26.792444 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:26.849583 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6991e-4346-4e1f-8b6b-25f0012fc24e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:26.853180 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d39e-b238-4757-8221-13e0ea6a9394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:26.853821 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d39e-b238-4757-8221-13e0ea6a9394 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:26.854105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d39e-b238-4757-8221-13e0ea6a9394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:26.854382 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d39e-b238-4757-8221-13e0ea6a9394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:26.863841 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d39e-b238-4757-8221-13e0ea6a9394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:26.865260 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d39e-b238-4757-8221-13e0ea6a9394 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:26.874519 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1449/2862] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:27.302072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422980d-d383-425d-940f-08afb587979e None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:27.303852 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-5422980d-d383-425d-940f-08afb587979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:27.317800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422980d-d383-425d-940f-08afb587979e None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:27.322357 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:27.323416 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.323636 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.323910 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] PATH_INFO: `/v3/projects/6a2c335723e24762a388fd7a5cfb59cd` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.325099 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2c335723e24762a388fd7a5cfb59cd)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:27.327040 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:27.426058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:27.437428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2c335723e24762a388fd7a5cfb59cd', 'request_id': 'req-8bb916b2-c43b-48e9-ba83-c0ca01331c15'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:27.444022 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2c335723e24762a388fd7a5cfb59cd', 'request_id': 'req-8bb916b2-c43b-48e9-ba83-c0ca01331c15'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:27.512148 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2c335723e24762a388fd7a5cfb59cd', 'request_id': 'req-8bb916b2-c43b-48e9-ba83-c0ca01331c15'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:27.528664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] The token cache is being invalidate because project 6a2c335723e24762a388fd7a5cfb59cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:24:27.531126 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:27.531901 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-8bb916b2-c43b-48e9-ba83-c0ca01331c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:27.533487 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1414/2863] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:24:27 2022] DELETE /identity/v3/projects/6a2c335723e24762a388fd7a5cfb59cd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:24:27.538381 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.538868 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.538966 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.556789 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:27.557970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:27.601970 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:27.615581 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1450/2864] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:27.624570 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.624868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.625152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.644610 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:27.645816 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:27.653868 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1415/2865] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:27.658168 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:27.667546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7655b99-0387-4638-850a-86e42eb96c48 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:27.672108 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:27.672753 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.673035 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.673309 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.674056 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:24:27.674355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:27.676018 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:27.688100 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1451/2866] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:24:27.692877 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:27.702066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e05f2-637a-4fb0-8983-573a29f58339 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:27.707664 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:27.708315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.708601 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.708885 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.709584 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:27.711518 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:27.792580 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1416/2867] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:24:27 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:24:27.796609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:27.806505 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987a6f-8798-41d0-a545-b6f9dc4eb28c admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:27.866825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:27.867530 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.867816 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.868093 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.868776 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:27.870679 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:27.958169 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1452/2868] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:24:27 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:27.962199 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:27.972488 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa723-b4a6-4d69-8b18-e556a9988122 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:27.977169 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:27.977832 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:27.978121 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:27.978401 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:27.979185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:27.980900 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:27.991906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1417/2869] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:27.995936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:28.006500 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331457f-d5e6-4fc1-80ec-d0b1a31d5f84 admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:28.011450 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43912-a0c2-4aeb-b1ee-d3dd300cbea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:28.012117 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43912-a0c2-4aeb-b1ee-d3dd300cbea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:28.012407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43912-a0c2-4aeb-b1ee-d3dd300cbea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:28.012689 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43912-a0c2-4aeb-b1ee-d3dd300cbea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:28.013448 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43912-a0c2-4aeb-b1ee-d3dd300cbea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:28.015052 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43912-a0c2-4aeb-b1ee-d3dd300cbea3 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:28.025214 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1453/2870] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:24:28.029281 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:28.039324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15155f8a-6e80-4c68-8fb1-3e046935ca52 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:28.044166 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:28.045037 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:28.045318 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:28.045612 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] PATH_INFO: `/v3/projects/05fc20458e124c3ab9ca7a5e1349896c/users/648622faa3a64f7d8f4afdc0c13f28ee/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:28.060384 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fc20458e124c3ab9ca7a5e1349896c, user_id=648622faa3a64f7d8f4afdc0c13f28ee, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:28.063008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:28.117668 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1418/2871] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:24:28 2022] PUT /identity/v3/projects/05fc20458e124c3ab9ca7a5e1349896c/users/648622faa3a64f7d8f4afdc0c13f28ee/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:24:28.128716 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:28.129007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:28.129635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:28.155430 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] MFA Rules not processed for user `648622faa3a64f7d8f4afdc0c13f28ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:28.156620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:28.218464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1454/2872] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:28.230619 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:28.232364 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:28.289703 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7430c13-4b9f-4e84-9fd7-0c9dd6b84dd9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:28.293415 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fd23d-d97f-40c5-b3bc-95e93e110c93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4091c55281ef4eeb8f2c4e9d84b2fe1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:28.294050 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd23d-d97f-40c5-b3bc-95e93e110c93 service glance] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:28.294331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd23d-d97f-40c5-b3bc-95e93e110c93 service glance] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:28.294605 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd23d-d97f-40c5-b3bc-95e93e110c93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:28.306947 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fd23d-d97f-40c5-b3bc-95e93e110c93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:28.308405 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fd23d-d97f-40c5-b3bc-95e93e110c93 service glance] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:28.317359 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1419/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 09:24:38.215682 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:38.313336 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:58.368409 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:58.436815 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57a477-86ce-404a-880f-cc4b775da4ed None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:58.441398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:58.442284 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:58.442574 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:58.442857 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] PATH_INFO: `/v3/users/648622faa3a64f7d8f4afdc0c13f28ee` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:58.444094 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=648622faa3a64f7d8f4afdc0c13f28ee)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:58.446044 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:58.638066 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648622faa3a64f7d8f4afdc0c13f28ee'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:58.645445 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648622faa3a64f7d8f4afdc0c13f28ee'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:58.646224 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648622faa3a64f7d8f4afdc0c13f28ee'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:58.646859 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648622faa3a64f7d8f4afdc0c13f28ee'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:58.659322 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648622faa3a64f7d8f4afdc0c13f28ee'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:58.722909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1455/2874] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:24:58 2022] DELETE /identity/v3/users/648622faa3a64f7d8f4afdc0c13f28ee => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:58.727495 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:58.727986 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:58.728093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:58.744929 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:58.746134 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:58.805835 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1420/2875] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:58.815364 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:58.816747 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:58.872862 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcba5f6-10a7-4636-9fd5-3788bb357a8a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:58.876522 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477228-c551-4a33-b556-7a3d3a5c80d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:58.877170 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477228-c551-4a33-b556-7a3d3a5c80d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:58.877460 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477228-c551-4a33-b556-7a3d3a5c80d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:58.877737 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477228-c551-4a33-b556-7a3d3a5c80d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:58.886831 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477228-c551-4a33-b556-7a3d3a5c80d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:58.888355 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477228-c551-4a33-b556-7a3d3a5c80d7 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:58.898082 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1456/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:24:59.283992 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:59.285389 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:59.297692 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf346c-b472-46b1-9a9a-b2856b803cbd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:59.303002 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:59.303921 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:59.304202 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:59.304503 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] PATH_INFO: `/v3/projects/05fc20458e124c3ab9ca7a5e1349896c` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:59.306505 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fc20458e124c3ab9ca7a5e1349896c)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:59.308557 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:59.550872 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fc20458e124c3ab9ca7a5e1349896c', 'request_id': 'req-39a5d87b-8583-46ff-bd70-0de2a19680e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:59.557494 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fc20458e124c3ab9ca7a5e1349896c', 'request_id': 'req-39a5d87b-8583-46ff-bd70-0de2a19680e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:59.641786 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fc20458e124c3ab9ca7a5e1349896c', 'request_id': 'req-39a5d87b-8583-46ff-bd70-0de2a19680e9'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:59.652826 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] The token cache is being invalidate because project 05fc20458e124c3ab9ca7a5e1349896c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:24:59.653117 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:59.653750 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-39a5d87b-8583-46ff-bd70-0de2a19680e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:24:59.655335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1421/2877] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:24:59 2022] DELETE /identity/v3/projects/05fc20458e124c3ab9ca7a5e1349896c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:24:59.660396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:59.660873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:59.661001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:59.679401 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:59.680612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:59.698063 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:24:59.740440 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1457/2878] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:59.749452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:59.749957 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:59.750066 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:59.768197 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:24:59.769564 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:24:59.777283 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1422/2879] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:24:59.781818 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:59.792145 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dca434-fe4c-40ac-9786-26cf0ac93017 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:59.796658 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:59.798844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:59.798844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:59.798844 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:59.799159 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:24:59.799418 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:59.801102 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:59.814952 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1458/2880] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 2 09:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:24:59.818965 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:59.828093 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d1e01-72e6-4c1e-bd51-2456c5a9cddd None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:24:59.832730 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:24:59.833374 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:24:59.833656 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:24:59.833931 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:24:59.834626 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:24:59.836690 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:24:59.930462 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1423/2881] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 2 09:24:59 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:24:59.934510 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:24:59.944696 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70975b-9f69-4b89-9a99-f7051bed4e8a admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:00.000334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:00.000999 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:00.001283 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:00.001588 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] PATH_INFO: `/v3/users` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:00.002281 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:00.004341 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:00.094348 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1459/2882] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 2 09:24:59 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:25:00.099058 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:00.109470 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751d4d-a138-46fe-b114-12988ba87ff0 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:00.114074 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:00.114731 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:00.115014 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:00.115331 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:00.116057 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:00.117822 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:00.133429 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1424/2883] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:25:00.137410 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:00.147941 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed8e0b-f9bd-451b-949f-3e2b366d806b admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:00.152486 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7ec8-84b4-4626-bfab-c1f680a78ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:00.153135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7ec8-84b4-4626-bfab-c1f680a78ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:00.153415 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7ec8-84b4-4626-bfab-c1f680a78ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:00.153692 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7ec8-84b4-4626-bfab-c1f680a78ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:00.154407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7ec8-84b4-4626-bfab-c1f680a78ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:00.156029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7ec8-84b4-4626-bfab-c1f680a78ea0 admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:00.166938 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1460/2884] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 2 09:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:25:00.170912 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:00.180778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc9c05-2301-46e7-a077-129861bc5458 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:00.185406 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:00.186404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:00.186689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:00.186964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] PATH_INFO: `/v3/projects/a1afba5def734565a9808a29d1faff5c/users/80e084ee6f2a41c18c42659b494c88a3/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:00.201212 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1afba5def734565a9808a29d1faff5c, user_id=80e084ee6f2a41c18c42659b494c88a3, role_id=bfb1f617183f4d9fa38a9b7b62d5c7ce)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:00.203855 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:00.265676 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1425/2885] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 2 09:25:00 2022] PUT /identity/v3/projects/a1afba5def734565a9808a29d1faff5c/users/80e084ee6f2a41c18c42659b494c88a3/roles/bfb1f617183f4d9fa38a9b7b62d5c7ce => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:25:00.276678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:00.276961 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:00.277242 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:00.303937 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] MFA Rules not processed for user `80e084ee6f2a41c18c42659b494c88a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:25:00.305139 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:00.369549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1461/2886] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:25:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:25:00.380404 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:00.385463 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:00.404930 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:00.440634 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a89-af97-4034-93c5-7519f5d7ffe9 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:00.446773 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443999-5d74-458b-9e96-fafedeff2419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:00.447513 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443999-5d74-458b-9e96-fafedeff2419 service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:00.447797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443999-5d74-458b-9e96-fafedeff2419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:00.448072 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443999-5d74-458b-9e96-fafedeff2419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:00.457830 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443999-5d74-458b-9e96-fafedeff2419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:00.459315 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443999-5d74-458b-9e96-fafedeff2419 service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:00.469428 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1426/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:25:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:25:10.366250 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:10.493732 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=17 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:14.665612 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:14.667006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:14.735898 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dc903-d2e7-40ad-94a2-8beeb4fd1f54 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:14.741204 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:14.741849 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:14.742138 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:14.742414 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:14.744174 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:14.756001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:14.757825 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:14.767602 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1462/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:25:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:25:24.763483 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=32 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:28.340556 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] REQUEST_METHOD: `POST` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:28.341021 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:28.341131 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:28.358257 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.auth.core [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] MFA Rules not processed for user `97d63985256745499be671657584f271`. Rule list: `[]` (Enabled: `True`). {{(pid=80266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:25:28.359479 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:28.414991 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1427/2889] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:25:28.999757 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:29.001289 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:29.057211 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a9d6-606a-4f43-8205-c03230e40799 service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:29.060936 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:29.061584 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:29.061865 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:29.062140 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:29.063909 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:29.073464 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:29.074875 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb454fc-b9b9-4c0f-a018-319dd78c543b service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:29.082984 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1463/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:25:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:25:38.408143 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=25 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:39.079162 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=26 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:40.595383 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:40.656547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd25df2-9cd7-4ab0-9477-7c2d00b4fe03 None None] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:40.661651 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:40.662506 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:40.662797 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:40.663075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] PATH_INFO: `/v3/users/80e084ee6f2a41c18c42659b494c88a3` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:40.664282 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e084ee6f2a41c18c42659b494c88a3)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:40.666185 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:40.798004 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e084ee6f2a41c18c42659b494c88a3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:40.804737 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e084ee6f2a41c18c42659b494c88a3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:40.805409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e084ee6f2a41c18c42659b494c88a3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:40.806032 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e084ee6f2a41c18c42659b494c88a3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:40.818084 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e084ee6f2a41c18c42659b494c88a3'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:40.869722 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1428/2891] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:25:40 2022] DELETE /identity/v3/users/80e084ee6f2a41c18c42659b494c88a3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:25:40.874398 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:40.878567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:40.878567 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:40.891904 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] MFA Rules not processed for user `7467262b6fdb458fb130b708a0227640`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:25:40.893087 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:40.954396 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1464/2892] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:25:40.964589 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:40.970118 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:41.024780 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90a04-c109-4ff5-991c-f2dbce2585f3 admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:41.028438 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:41.029116 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:41.029399 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:41.029680 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:41.038950 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:41.040412 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:41.049743 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1429/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:25:41.444695 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:25:41.446299 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:25:41.458832 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d7fd8-d0f1-437f-9f77-790f9e351478 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:25:41.464893 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:25:41.465872 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:25:41.466230 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:25:41.466585 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] PATH_INFO: `/v3/projects/a1afba5def734565a9808a29d1faff5c` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:25:41.468006 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1afba5def734565a9808a29d1faff5c)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:25:41.473543 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:25:41.602007 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1afba5def734565a9808a29d1faff5c', 'request_id': 'req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:41.608290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1afba5def734565a9808a29d1faff5c', 'request_id': 'req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:41.692769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1afba5def734565a9808a29d1faff5c', 'request_id': 'req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:41.703337 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] The token cache is being invalidate because project a1afba5def734565a9808a29d1faff5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:25:41.703627 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:41.704244 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-e7e6af68-f76f-47a2-b48a-579ca88fc2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:25:41.705773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1465/2894] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:25:41 2022] DELETE /identity/v3/projects/a1afba5def734565a9808a29d1faff5c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:25:51.045535 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:51.700272 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:15.634420 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:27:15.642940 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff3ea-21ea-44b0-9753-703edaf23757 service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:27:15.690725 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:27:15.691403 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:15.691689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:15.691964 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:15.693707 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:15.702983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:27:15.704381 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:27:15.712980 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1430/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:27:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:27:25.709324 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=26 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:36.698518 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] REQUEST_METHOD: `POST` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:36.698998 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:36.699105 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:36.716769 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.auth.core [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] MFA Rules not processed for user `97d63985256745499be671657584f271`. Rule list: `[]` (Enabled: `True`). {{(pid=80267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:27:36.717956 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:36.771227 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1466/2896] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 2 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 09:27:36.807932 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:27:36.809365 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:36.867288 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134ee2-454f-40ba-a4de-10d41dec354e service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:27:36.870778 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20e0dbc56e48299b586a3b33c0767d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:27:36.871450 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:36.871734 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:36.872009 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:36.873758 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:36.960008 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:27:36.961436 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:27:36.981629 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1431/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:27:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:27:37.983147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:27:37.989253 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:37.998265 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930fe3-9806-4197-8a8d-259f94ca1343 None None] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:27:38.001823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:27:38.002451 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:38.002778 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:38.003045 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:38.007748 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:38.021972 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:27:38.023443 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:27:38.035609 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1467/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:27:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:27:42.218766 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:27:42.220414 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:42.235805 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72aea5-63b5-439b-8729-32fcbb3cd2db service cinder] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:27:42.245144 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:27:42.246301 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:42.246781 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:42.247216 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:42.249521 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:42.263727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:27:42.265335 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:27:42.277344 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1432/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:27:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:27:47.392135 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:27:47.394111 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:47.407756 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef697-0748-4577-bf37-b07737127f77 service neutron] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:27:47.413878 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:27:47.414534 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:47.414802 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:47.415085 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:47.416823 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:47.426662 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:27:47.428249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:27:47.437029 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1468/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:27:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:27:52.272087 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=72 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:54.952277 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:27:54.963498 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952c84c-5a86-4cdd-b8f8-9ab46e1fd309 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:27:54.969013 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:27:54.969689 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:27:54.969973 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:27:54.970248 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:27:54.972089 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:27:54.985075 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:27:54.985621 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:27:54.996547 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1433/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:27:57.432973 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=37 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:28:04.992139 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=6 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:33.857517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:33.870086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ed71a-a664-4d20-af2d-1db93908cca0 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:33.875811 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7ba842465543478b83e1bf3c018223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:33.876546 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:33.876901 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:33.877249 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:33.879979 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:33.893850 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:33.895548 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:33.907161 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1469/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:29:43.902830 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=6 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:49.264727 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:49.274711 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d7c4-bf9b-4ca0-a88d-3d4eaf0e25f4 service nova] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:49.278228 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b8fa2fe2d046dcadd150265b166d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:49.278866 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:49.279147 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:49.279452 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:49.281189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:49.343395 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:49.344821 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:49.354372 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1434/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:29:52.813573 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:52.815086 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:52.884717 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f440bf-0786-4d31-adae-33835a645613 service nova] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:52.889773 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:52.890431 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:52.890720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:52.891001 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:52.892873 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:52.904556 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:52.908644 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:52.916488 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1470/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:29:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:29:56.321659 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:56.332939 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56c791-df28-41e1-baea-75c4ecd2a82c service neutron] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:56.338152 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:56.338800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] REQUEST_METHOD: `GET` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:56.339090 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:56.339422 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:56.341189 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:56.352876 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:56.354509 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:56.365424 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1435/2905] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:29:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:29:56.420103 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:56.421620 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:56.437334 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9f5d-9674-40fb-92fb-8676a6bb781b service placement] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:56.441896 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:56.446549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:56.446549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:56.446549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] PATH_INFO: `/v3/users/97d63985256745499be671657584f271` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:56.446549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d63985256745499be671657584f271)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:56.446549 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:56.591290 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d63985256745499be671657584f271'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:56.598481 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d63985256745499be671657584f271'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:56.599130 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d63985256745499be671657584f271'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:56.599801 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d63985256745499be671657584f271'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:56.612336 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d63985256745499be671657584f271'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:56.680987 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1471/2906] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:29:56 2022] DELETE /identity/v3/users/97d63985256745499be671657584f271 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:29:56.916851 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:56.929672 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab50af-1c39-4767-94d9-72a4530fd805 service placement] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:56.988307 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:56.989224 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:56.989514 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:56.989798 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] PATH_INFO: `/v3/projects/9808f004162146c089568a0261f09d59` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:56.990981 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9808f004162146c089568a0261f09d59)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:56.992911 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:57.093296 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9808f004162146c089568a0261f09d59', 'request_id': 'req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.100111 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9808f004162146c089568a0261f09d59', 'request_id': 'req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.167201 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9808f004162146c089568a0261f09d59', 'request_id': 'req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.177702 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] The token cache is being invalidate because project 9808f004162146c089568a0261f09d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:29:57.177983 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.178599 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.180157 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1436/2907] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:29:56 2022] DELETE /identity/v3/projects/9808f004162146c089568a0261f09d59 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:29:57.184147 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:57.185550 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:57.198903 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb447fb7-2f5f-4278-8e59-d18d49901dab admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:57.253476 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:57.257295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:57.257295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:57.257295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] PATH_INFO: `/v3/users/23c0f701d91c4dd7983b98a33d9233f7` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:57.257295 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c0f701d91c4dd7983b98a33d9233f7)` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:57.258252 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:57.260517 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:57.430673 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c0f701d91c4dd7983b98a33d9233f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.437884 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c0f701d91c4dd7983b98a33d9233f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.438563 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c0f701d91c4dd7983b98a33d9233f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.439720 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c0f701d91c4dd7983b98a33d9233f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.451533 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.notifications [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c0f701d91c4dd7983b98a33d9233f7'} {{(pid=80267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:57.538088 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1472/2908] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 2 09:29:57 2022] DELETE /identity/v3/users/23c0f701d91c4dd7983b98a33d9233f7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:29:57.786611 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Authenticating user token {{(pid=80266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:29:57.791635 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.fernet_utils [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:29:57.804409 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642730a-54b6-4fc1-bd03-0d2f6d9f2f3c admin admin] Validating token access rules against request {{(pid=80266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:29:57.813106 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:57.862263 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7467262b6fdb458fb130b708a0227640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4962d1508e764b5186cbd90b7013448e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:29:57.863128 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:29:57.863443 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] SCRIPT_NAME: `/identity` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:29:57.863726 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] PATH_INFO: `/v3/projects/85a37c843ef44706b107c0a0ce5106fc` {{(pid=80266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:29:57.864906 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a37c843ef44706b107c0a0ce5106fc)` {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:29:57.866804 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] RBAC: Authorization granted {{(pid=80266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:29:58.019801 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a37c843ef44706b107c0a0ce5106fc', 'request_id': 'req-e278c49c-7654-487b-97dd-0d53174a020b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:58.026095 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a37c843ef44706b107c0a0ce5106fc', 'request_id': 'req-e278c49c-7654-487b-97dd-0d53174a020b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:58.104317 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a37c843ef44706b107c0a0ce5106fc', 'request_id': 'req-e278c49c-7654-487b-97dd-0d53174a020b'} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:58.115892 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] The token cache is being invalidate because project 85a37c843ef44706b107c0a0ce5106fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 09:29:58.116180 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:58.116800 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG keystone.notifications [None req-e278c49c-7654-487b-97dd-0d53174a020b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 09:29:58.118321 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: [pid: 80266|app: 0|req: 1437/2909] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 2 09:29:57 2022] DELETE /identity/v3/projects/85a37c843ef44706b107c0a0ce5106fc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:30:07.534407 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:30:08.112827 dv-cinder-825492-19-iscsi devstack@keystone.service[80266]: DEBUG dbcounter [-] [80266] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:30:20.890678 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Authenticating user token {{(pid=80267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:30:20.892109 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:30:20.963048 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f535-14d0-496e-a9b6-9da798f3357e admin admin] Validating token access rules against request {{(pid=80267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:30:21.020497 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db6adef34dc34d9e8b67547fe54ecf08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b95c39fe1b54ea284ba0cf6156db620', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:30:21.021635 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] REQUEST_METHOD: `GET` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:30:21.021922 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:30:21.022196 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:30:21.024005 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.fernet_utils [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:30:21.034897 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:30:21.036507 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a7f4a-9453-43a4-bbb9-bcdd5955afb3 service placement] RBAC: Authorization granted {{(pid=80267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:30:21.046760 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: [pid: 80267|app: 0|req: 1473/2910] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 2 09:30:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 09:30:31.042601 dv-cinder-825492-19-iscsi devstack@keystone.service[80267]: DEBUG dbcounter [-] [80267] Writing DB stats keystone:SELECT=58 {{(pid=80267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}